-- Logs begin at Wed 2022-06-22 17:45:19 UTC, end at Wed 2022-06-22 19:01:47 UTC. -- Jun 22 18:23:57.964838 dv-cinder-812685-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 18:23:57.973382 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 18:23:57 2022] *** Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: nodename: dv-cinder-812685-11-iscsi Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: machine: x86_64 Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: clock source: unix Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: pcre jit disabled Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: detected number of CPU cores: 4 Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: current working directory: / Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: detected binary path: /usr/bin/uwsgi-core Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: your processes number limit is 47680 Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: your memory page size is 4096 bytes Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: detected max file descriptor number: 2048 Jun 22 18:23:57.975456 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: lock engine: pthread robust mutexes Jun 22 18:23:57.976250 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: thunder lock: enabled Jun 22 18:23:57.976250 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 18:23:57.976250 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 18:23:58.019756 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: Python main interpreter initialized at 0x5602f0daa9c0 Jun 22 18:23:58.019756 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: python threads support enabled Jun 22 18:23:58.019756 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: your server socket listen backlog is limited to 100 connections Jun 22 18:23:58.019756 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: your mercy for graceful operations on workers is 90 seconds Jun 22 18:23:58.020102 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 18:23:58.020179 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: *** Operational MODE: preforking *** Jun 22 18:23:58.020445 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: *** uWSGI is running in multiple interpreter mode *** Jun 22 18:23:58.020445 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: spawned uWSGI master process (pid: 80312) Jun 22 18:23:58.020637 dv-cinder-812685-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 18:23:58.022053 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: spawned uWSGI worker 1 (pid: 80322, cores: 1) Jun 22 18:23:58.022053 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: spawned uWSGI worker 2 (pid: 80323, cores: 1) Jun 22 18:23:58.022053 dv-cinder-812685-11-iscsi devstack@keystone.service[80312]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 18:24:03.461216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:24:03.461216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: from cryptography.utils import int_from_bytes Jun 22 18:24:03.462008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:24:03.462008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: from cryptography.utils import int_from_bytes Jun 22 18:24:03.462116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:24:03.462116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes Jun 22 18:24:03.462116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:24:03.462116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes Jun 22 18:24:03.510993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 18:24:03.511194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 18:24:03.511330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 18:24:03.511437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] command line args: [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 18:24:03.511513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 18:24:03.511642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 18:24:03.511736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] command line args: [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 18:24:03.511814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ================================================================================ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 18:24:03.511981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 18:24:03.512068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] admin_token = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ================================================================================ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 18:24:03.512310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] config_dir = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] config_dir = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] config_source = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] debug = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.512991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] config_source = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] debug = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.513917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_config_append = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_config_append = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_dir = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.514942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_dir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.515930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.516947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.517878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.518901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] publish_errors = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] publish_errors = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.519961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] standard_threads = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] standard_threads = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.520978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] use_journal = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] use_json = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] use_journal = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] use_stderr = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.521944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] use_json = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.522060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] use_syslog = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.522182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] use_stderr = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.522182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] use_syslog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.522397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.522516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:24:03.522638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.522752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.522874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.522989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.523955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.524906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.525972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.526987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.527947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.528887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.529959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.530892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531247 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.531886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.532907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.533958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.534940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.535913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.536940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.537881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.538930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.539932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.540996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.541948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.542900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.543976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.544947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.545886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.546950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.547065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.547441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.547562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.547686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.547803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.external = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.547971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.external = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.password = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.548966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.password = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.token = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.token = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.549917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.550984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.551944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.552894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.553018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.553622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.553738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.553863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.554961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.555930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.556890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.557951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.558982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.559960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.560914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.561987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.562943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.563900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.564968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.565919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566749 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.566982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.567981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.568101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.568218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.568333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.568462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.568614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.569308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.569568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.569694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.569812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.569927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.570894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.571996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.572950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.573909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.574968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.575985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.576926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.577975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.578920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.579988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.580938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.581993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] role.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] role.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.582994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] role.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] role.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.583985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.584924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.585983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.586918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.587873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.588003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.588123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.588548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.588671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.588787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.588903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.589970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.590906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.591999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.592940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.593888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.594939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.595949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.596903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.597966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.598904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599726 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.599900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.600117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.600239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:24:03.600356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 18:24:03.600473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 18:24:03.625972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.626113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.626211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.626291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.626403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.626491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.636097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.636273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.664445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.664573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.664710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.664792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.807133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.807898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.856498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.856727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.857112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.857345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.923966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.924075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.924159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.924287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.924372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.924498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.949985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.950982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.951104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.951451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.951451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.951596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.951670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.951753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.962519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.962720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.975728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.975983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.976925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.977049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.977131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.977322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.977531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 18:24:03.994916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.995125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 18:24:03.995241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.995451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 18:24:03.995547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.995650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 18:24:03.995783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.995948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 18:24:03.996208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:03.996980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.007520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.007737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.007822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.008296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.008380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.008558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.008643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.008830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.016822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.017056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.020084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.020318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.020400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.020593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.020676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.020867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.020989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.021143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.021230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.021393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.021483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.021656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.021736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.022454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.022539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.022722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.022935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.023043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.023250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.023331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.023527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.023793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.050856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.050994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.052489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.052594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.052759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.052845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.058120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.058223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.058506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.058589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.058783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.058866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.066023 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.066108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.066303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.066401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.070880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.070984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.071158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.071241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.071434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.071519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.071710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.071790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.072885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.091904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.092003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.092177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.092261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.096785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.096873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.100541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.100695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.100924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.101089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.105933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.106083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.109543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.109686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.113187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.113303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.113488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.113603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.113769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.113885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.114052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.114163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.114327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.114435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.114608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.114698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.134379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.134483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.134656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.134742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.134931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.135014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.135198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.135280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.143008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.143176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.144725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.144907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.144999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.145074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.148701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.148839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.148980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.149914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.163033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.163151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.163308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.163404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.163589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.163683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.163882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.163969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.165471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.165557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.165763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.165860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.166058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.166143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.184264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.184365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.187515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.187602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.190786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.190875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.192523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.192621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.194244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.194327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.194520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.194604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.194795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.194887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.202058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.202151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.203641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.203732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.206873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.206963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.207159 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.207243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.207540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.207635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.207813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.207927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.217430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.217562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.217713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.217842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.217988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.218114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.225873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.226079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 18:24:04.226175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.226352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.226435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.226627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.226712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.226898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.226990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.227161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.227273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.227525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.227608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.227814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.227925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.228981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.229156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.229238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.229424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.229505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.229684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 18:24:04.268540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602f0daa9c0 pid: 80323 (default app) Jun 22 18:24:04.268642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602f0daa9c0 pid: 80322 (default app) Jun 22 18:24:04.272008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ac0c-8b4c-40ce-9c9a-76093af96eb5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:04.272301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ac0c-8b4c-40ce-9c9a-76093af96eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:04.272619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ac0c-8b4c-40ce-9c9a-76093af96eb5 None None] PATH_INFO: `/v3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:04.276825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Jun 22 18:24:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:12.074966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:12.075503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:12.075503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:12.079772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:12.086169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:12.086595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:12.086732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:12.159984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: INFO dbcounter [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] Registered counter for database keystone Jun 22 18:24:12.181106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG oslo_db.sqlalchemy.engines [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:24:12.187301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writer thread running {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:24:12.373240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80323) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 18:24:12.373593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80323) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 18:24:12.429816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:12.431420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:12.556477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 18:24:12.679552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:12.750028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: INFO dbcounter [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] Registered counter for database keystone Jun 22 18:24:12.769786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG oslo_db.sqlalchemy.engines [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:24:12.776269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writer thread running {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:24:12.898615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e520a-8b9c-438f-996e-dfeb41e2a85b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:12.902873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:12.903529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:12.903819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:12.904126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:12.912892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:12.965151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 18:24:12.965438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0623e1a-016c-424e-9403-53133fd487ca admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:12.977296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jun 22 18:24:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 18:24:12.983284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:12.997755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf23fa-aeee-4e0b-bcb3-aa95942c2a51 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:13.002197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:13.003307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:13.003598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:13.003905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] PATH_INFO: `/v3/projects/5555f070d6fd48a3923494f663482206` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:13.005393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] RBAC: Authorizing `identity:get_project(project_id=5555f070d6fd48a3923494f663482206)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:13.059055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING keystone.common.rbac_enforcer.enforcer [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 18:24:13.059404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cc8c4-02e0-46ae-ae0b-73a07cdc5c0f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:13.064049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Jun 22 18:24:12 2022] GET /identity/v3/projects/5555f070d6fd48a3923494f663482206 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:15.066161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f2cb6-0492-49a0-a585-375a7aebd884 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:15.066667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f2cb6-0492-49a0-a585-375a7aebd884 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:15.066667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f2cb6-0492-49a0-a585-375a7aebd884 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:15.071422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:15.076920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:15.077359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:15.077479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:15.096245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:15.097765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:15.105866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 18:24:15.127697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f2cb6-0492-49a0-a585-375a7aebd884 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:15.140613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f2cb6-0492-49a0-a585-375a7aebd884 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:15.144820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064269c-1721-4679-9c0a-bebfd94170c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:15.145449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064269c-1721-4679-9c0a-bebfd94170c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:15.145737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064269c-1721-4679-9c0a-bebfd94170c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:15.146017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064269c-1721-4679-9c0a-bebfd94170c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:15.154357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064269c-1721-4679-9c0a-bebfd94170c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:15.156191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064269c-1721-4679-9c0a-bebfd94170c5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:15.165176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jun 22 18:24:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 18:24:15.170726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:15.179653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0b1e-029a-4435-b93d-6b5ca8512a4b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:15.184067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8720abd-4263-4849-8431-bb117d8ca988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:15.184919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720abd-4263-4849-8431-bb117d8ca988 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:15.185205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720abd-4263-4849-8431-bb117d8ca988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:15.185482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720abd-4263-4849-8431-bb117d8ca988 admin admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:15.186858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8720abd-4263-4849-8431-bb117d8ca988 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:15.188723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8720abd-4263-4849-8431-bb117d8ca988 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:15.190555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Jun 22 18:24:15 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:17.290923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408e00b-5265-488d-987d-a52fed42ca90 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.291452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408e00b-5265-488d-987d-a52fed42ca90 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.291540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408e00b-5265-488d-987d-a52fed42ca90 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.292874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:17.297946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.298328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.298637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.309170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83553-e21d-47e4-8cda-977e5bfdb6f0 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.309467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83553-e21d-47e4-8cda-977e5bfdb6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.309756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83553-e21d-47e4-8cda-977e5bfdb6f0 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.311079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:17.315513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:17.316012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.316306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.316588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.316755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:17.357608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG passlib.handlers.bcrypt [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80322) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 18:24:17.358039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG passlib.handlers.bcrypt [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80322) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 18:24:17.397629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:17.405437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:17.407027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:17.420933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:17.444889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:17.510518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:17.525728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116519-d1ae-42a0-8355-5af77a57fe91 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:17.532756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:17.559086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:17.559817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.560147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.560430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.571269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:17.582302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:17.583356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:17.584838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:17.589817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:17.631765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41649736-af36-4a2e-b0fa-228b588e4f21 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:17.634348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:17.670570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:17.671437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:17.671547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.671742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.672063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.689410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2007c4a-6b0c-45a9-a8eb-1e41a71d01e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:17.722899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:17.723566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.723881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.724169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.725030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:17.725348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:17.726775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:17.737291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:17.738275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:17.738892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:17.744459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:17.840228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:24:17.843256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f907d8e-7954-4855-ac76-5ae2982a7b24 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:17.845892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:17.848554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:17.876994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:17.877866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.878148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.878422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.879627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:17.881682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:17.883564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:17 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:17.888903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:17.903144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:17.945010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeced1-ba15-4139-91a3-968e2e3ed2a9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:17.978267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:17.979058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:17.979345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:17.979624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:17.986694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c239de-9cf5-496b-b096-78dae2301db6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:17.999517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:18.002849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:18.021751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:18.022629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:18.022923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:18.023206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:24:18.023524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:18.024326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:18.025113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:24:18.025113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:24:18.025113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:24:18.025113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:18.025320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:18.025382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:18.025886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:18.027498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:18.030460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:18.032830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:18.088125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:18.114511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:18.133690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46bd0-b895-43a3-8f38-483458dcdd14 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:18.134697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac6b8-2cb2-434b-b437-b604b49dbbaf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:18.166339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:18.166993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:18.167277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:18.167553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:18.167894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:18.168306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:18.168554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:18.168647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:18.168846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:18.169129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:18.169966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.domain.id=default, user.id=2a54999c7536405a8d0c6aa5dc9fba82) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:18.170062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd01c9-f881-4503-9ce4-afa0ba4911ea None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:18.170286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:18.171719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7f36c-d4eb-4b6d-88e5-c1e7e2b6a5cb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:18.178611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jun 22 18:24:18 2022] GET /identity/v3/role_assignments?user.id=2a54999c7536405a8d0c6aa5dc9fba82&scope.domain.id=default&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:18.187658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:20.399917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cd75-c2cb-44b6-981b-8b7870ef1655 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:20.400427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cd75-c2cb-44b6-981b-8b7870ef1655 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:20.400499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cd75-c2cb-44b6-981b-8b7870ef1655 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:20.402034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:20.407273 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99332819-599a-40af-a8a1-a9b27d0edf1d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:20.407703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99332819-599a-40af-a8a1-a9b27d0edf1d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:20.407869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99332819-599a-40af-a8a1-a9b27d0edf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:20.433760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-99332819-599a-40af-a8a1-a9b27d0edf1d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:20.435218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-99332819-599a-40af-a8a1-a9b27d0edf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:20.530149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:20.567510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498cd75-c2cb-44b6-981b-8b7870ef1655 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:20.623732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1994d-5100-4df6-9b66-caf8cc6a6ea4 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:20.624378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1994d-5100-4df6-9b66-caf8cc6a6ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:20.624888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1994d-5100-4df6-9b66-caf8cc6a6ea4 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:20.626460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:20.631848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:20.632391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:20.632927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:20.670310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:20.672795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:20.740579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:20.781575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498cd75-c2cb-44b6-981b-8b7870ef1655 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:20.782136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:20.837487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:20.838295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:20.838582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:20.838861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:20.842656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:20.860774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:20.869524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:20.870405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:20.871166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:20.873928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 13/26] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:20.879420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:20.887399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.004367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c4a2-8df2-4ef2-9a4c-2a2770f39417 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.046680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1345-b370-4d32-90e6-8404c68bffbc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.078298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.079108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.079398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.079682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.101588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.103135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.118487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.119174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.119464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.119747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.120550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:21.120867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.123910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e79721-0be0-438c-94c1-a940fca1202a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.134106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 14/27] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f885383b-dac6-4bd7-9e5f-513c9bef30de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:24:21.134903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:21.135694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:21.136531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:24:21.136531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:24:21.136531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:24:21.136531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:21.136531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:21.141842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166931-d8b3-4930-ac3f-8d6a0cf443b8 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.141842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166931-d8b3-4930-ac3f-8d6a0cf443b8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.141842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166931-d8b3-4930-ac3f-8d6a0cf443b8 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.141842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 15/29] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:21.141842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166931-d8b3-4930-ac3f-8d6a0cf443b8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:21.143303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573ab2-e5be-4631-a164-c53cebb6062a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.143802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573ab2-e5be-4631-a164-c53cebb6062a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.144324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573ab2-e5be-4631-a164-c53cebb6062a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.146070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:21.147811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.148315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.148785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.167237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:21.168448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:21.188021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.257530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.269333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 16/31] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:21.275714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:21.296697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166931-d8b3-4930-ac3f-8d6a0cf443b8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.335294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1657f3-71b4-44a3-893b-34fae8e70202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.336208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1657f3-71b4-44a3-893b-34fae8e70202 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.336493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1657f3-71b4-44a3-893b-34fae8e70202 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.336771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1657f3-71b4-44a3-893b-34fae8e70202 None admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.338699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1657f3-71b4-44a3-893b-34fae8e70202 None admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.340002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1657f3-71b4-44a3-893b-34fae8e70202 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.342059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 16/32] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:21 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:21.343409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.343732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.344083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.361297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:21.362528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:21.414627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea6cb0-0498-4cea-9e5c-d2ad81521187 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.437699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:21.439164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:21.469370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.470863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.471608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.472099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.473276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:21.474193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.476166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.476839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.504037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:21.504037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:21.561411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.577036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5440b-0a44-4074-b5a8-b13888dcefa5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.610023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d227a-b0c1-4a10-a8ff-1db98c30ad38 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.622475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.623754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.624275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.624784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.626212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.628082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.651152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.652413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.652832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.653258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.654784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.656513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.658646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 18/35] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:21.659501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:21.778502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e0e55-d41b-40f2-b506-1e201cb030b0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.787453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 18/36] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 18:24:21 2022] POST /identity/v3/roles => generated 225 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:21.787453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:21.837090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.859276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0bcb-7baa-4cac-949d-614df9a9ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.860033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0bcb-7baa-4cac-949d-614df9a9ddc9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.860319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0bcb-7baa-4cac-949d-614df9a9ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.860595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0bcb-7baa-4cac-949d-614df9a9ddc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.861358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0bcb-7baa-4cac-949d-614df9a9ddc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.862839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0bcb-7baa-4cac-949d-614df9a9ddc9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:21.928091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:21.947374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ee569-e002-49a2-a785-d3aaa57bc59f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:21.985155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:21.986294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:21.986792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:21.987329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:21.988365 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:21.990543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:22.038088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:24:21 2022] POST /identity/v3/projects => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:22.038970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:22.129588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 19/38] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 18:24:21 2022] POST /identity/v3/roles => generated 219 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:22.132942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded074-941d-419c-b045-708099ab538b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.133799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded074-941d-419c-b045-708099ab538b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.134299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded074-941d-419c-b045-708099ab538b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.136095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:22.142508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b06e3-df83-451e-9e46-2234a05ab58e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.144035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b06e3-df83-451e-9e46-2234a05ab58e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.144567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b06e3-df83-451e-9e46-2234a05ab58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.167478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-899b06e3-df83-451e-9e46-2234a05ab58e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:22.170079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-899b06e3-df83-451e-9e46-2234a05ab58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:22.258611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fa4e5-2966-40c3-b5ea-e6727a9afcae None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:22.274975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 21/40] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:22.277143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccaf8-509e-45e9-866e-982c514d3f9f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.278018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccaf8-509e-45e9-866e-982c514d3f9f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.279166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccaf8-509e-45e9-866e-982c514d3f9f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.281653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 22/41] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:22.289458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.289752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.290024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.316133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:22.317084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.317372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.317549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:22.317643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] PATH_INFO: `/v3/domains/default/users/2a54999c7536405a8d0c6aa5dc9fba82/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.318802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:22.320560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2a54999c7536405a8d0c6aa5dc9fba82, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:22.322076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:22.339335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:22.346244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 20/42] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Jun 22 18:24:22 2022] PUT /identity/v3/domains/default/users/2a54999c7536405a8d0c6aa5dc9fba82/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:22.347144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:22.415768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 23/43] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:22.446697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:22.492006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ddde-a3e3-48fa-b515-2979152783b9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:22.513128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:22.535606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:22.536346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.536645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.537452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.538230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:22.539656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:22.553996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 21/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 18:24:22 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:22.578516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6148cda-2c44-4cc7-af94-31a88d067c48 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:22.626039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee55a7-5c47-42ca-bb7f-72e54620c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:22.627274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee55a7-5c47-42ca-bb7f-72e54620c034 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.627718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee55a7-5c47-42ca-bb7f-72e54620c034 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.628189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee55a7-5c47-42ca-bb7f-72e54620c034 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.630154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee55a7-5c47-42ca-bb7f-72e54620c034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:22.632876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee55a7-5c47-42ca-bb7f-72e54620c034 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:22.636077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 24/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:22.642270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:22.712108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:22.764734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d658f-ca8b-47d2-bd7c-eb9b49a80809 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:22.800475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ded616-8827-42a2-a962-12b3442fd54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:22.801145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded616-8827-42a2-a962-12b3442fd54d None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:22.801440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded616-8827-42a2-a962-12b3442fd54d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:22.801733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded616-8827-42a2-a962-12b3442fd54d None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:22.802499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ded616-8827-42a2-a962-12b3442fd54d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:22.804007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ded616-8827-42a2-a962-12b3442fd54d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:22.830529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:24:22 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:24.422469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c1044-1363-4316-8dfe-d7f53641f246 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.422987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c1044-1363-4316-8dfe-d7f53641f246 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.423092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c1044-1363-4316-8dfe-d7f53641f246 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:24.424602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:24.429735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.430118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.430432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:24.447661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:24.449208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:24.514980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:24.539175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c1044-1363-4316-8dfe-d7f53641f246 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:24.638893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c1044-1363-4316-8dfe-d7f53641f246 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:24.652991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:24.675545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:24.676301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.676587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.676862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:24.689015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:24.698093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:24.699119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:24.700031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 26/49] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:24.705418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:24.747913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:24.808220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4b3fd-4075-402e-b66a-6eedbaf48dea None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:24.841022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:24.841683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.841968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.842245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:24.842995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:24.843307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:24.844724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7bf6-cbdf-448a-99fd-def3c0f6a165 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:24.856349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 24/50] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:24.861787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:24.925803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc688-fff1-4a33-bfb2-57d2220b088d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.925996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc688-fff1-4a33-bfb2-57d2220b088d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.926279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc688-fff1-4a33-bfb2-57d2220b088d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:24.927709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 25/51] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:24.933318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.933606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.933887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:24.950775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:24.951982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:24.963696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1665e-3098-4c39-a67e-1aeba7d0d46f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:24.997357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:24.998279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:24.998569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:24.998853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:25.000424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:25.001983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:25.003769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:24 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:25.010294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:25.055618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:25.116378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ac3f5-cc71-4d7a-9b5e-56e4d46d9847 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:25.124102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 26/53] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:25.148077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:25.149072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:25.149892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:25.150161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:25.150440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:25.151640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:25.153142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:25.154788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:25.160283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:25.179091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:25.247112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c79965-0df3-4474-8d35-b55068d39d64 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:25.259299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88d1b-9def-4e43-a0af-4240c53ace3a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:25.267804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:25.281479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:25.282284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:25.282573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:25.282857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:25.284080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:25.285564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:25.287797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:25.293263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:25.295798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:25.296555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:25.296846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:25.297125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:25.297968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.domain.id=default, user.id=2a54999c7536405a8d0c6aa5dc9fba82) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:25.298281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:25.299887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3d20-96df-4c65-a64b-fda1a2db0eed None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:25.307382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jun 22 18:24:25 2022] GET /identity/v3/role_assignments?user.id=2a54999c7536405a8d0c6aa5dc9fba82&scope.domain.id=default&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:25.407329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:25.410546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ffb7-da8a-41bc-bf81-c3051f7b451d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:25.459593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506ad9a-e8b1-451b-8fa8-1dd7a132f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:25.460579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506ad9a-e8b1-451b-8fa8-1dd7a132f2ff None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:25.460579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506ad9a-e8b1-451b-8fa8-1dd7a132f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:25.460828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506ad9a-e8b1-451b-8fa8-1dd7a132f2ff None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:25.461587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506ad9a-e8b1-451b-8fa8-1dd7a132f2ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:25.463112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506ad9a-e8b1-451b-8fa8-1dd7a132f2ff None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:25.494267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jun 22 18:24:25 2022] POST /identity/v3/projects => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:24:27.625946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614304-101b-446f-9a59-7f43ab839e15 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:27.626463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614304-101b-446f-9a59-7f43ab839e15 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:27.626568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614304-101b-446f-9a59-7f43ab839e15 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:27.627920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:27.634009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:27.634406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:27.634574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:27.651467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:27.652666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:27.716505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:27.741718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab614304-101b-446f-9a59-7f43ab839e15 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:27.843509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab614304-101b-446f-9a59-7f43ab839e15 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:27.876584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eebbe2-c106-4d15-8f63-b2a9b005845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:27.877311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eebbe2-c106-4d15-8f63-b2a9b005845a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:27.877601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eebbe2-c106-4d15-8f63-b2a9b005845a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:27.877879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eebbe2-c106-4d15-8f63-b2a9b005845a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:27.879060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eebbe2-c106-4d15-8f63-b2a9b005845a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:27.880548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eebbe2-c106-4d15-8f63-b2a9b005845a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:27.883398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:27.889017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:27.968366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:27.986483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a261b-ee90-4fcd-893c-810cebffc600 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:28.020570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4162c-e7c5-4995-9041-c820ed7e242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:28.021232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4162c-e7c5-4995-9041-c820ed7e242a None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:28.022136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4162c-e7c5-4995-9041-c820ed7e242a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:28.022425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4162c-e7c5-4995-9041-c820ed7e242a None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:28.023154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4162c-e7c5-4995-9041-c820ed7e242a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:28.024629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4162c-e7c5-4995-9041-c820ed7e242a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:28.049896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:27 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:31.281338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3772-89cc-47a1-a7dd-d8e5470b94f4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.282382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3772-89cc-47a1-a7dd-d8e5470b94f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.282874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3772-89cc-47a1-a7dd-d8e5470b94f4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.284496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:31.290122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b495b-9f2e-4372-b58f-d5c7b8784b1e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.290996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b495b-9f2e-4372-b58f-d5c7b8784b1e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.291516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b495b-9f2e-4372-b58f-d5c7b8784b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.316872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-da6b495b-9f2e-4372-b58f-d5c7b8784b1e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:31.318997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-da6b495b-9f2e-4372-b58f-d5c7b8784b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:31.340806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34a1a-6b66-4e65-8040-73f7771be0d1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.341422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34a1a-6b66-4e65-8040-73f7771be0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.341930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34a1a-6b66-4e65-8040-73f7771be0d1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.343519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 33/63] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:31.348968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.350011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.350515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.370900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:31.372454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:31.408799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:31.409128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 31/64] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:31.415863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daeb5b-3fd0-4f89-b21d-48200595741c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.416515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daeb5b-3fd0-4f89-b21d-48200595741c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.416963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daeb5b-3fd0-4f89-b21d-48200595741c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.419620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 32/65] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:31.433750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.434258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.434681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.452344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 34/66] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:31.453395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:31.460497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:31.461887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:31.530131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:31.539238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 33/67] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:31.540372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:31.575345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1dc3e-1e9c-4b6d-a62e-572996d69fa2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:31.621787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:31.622857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.623314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.623729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.639036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:31.650853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:31.651975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:31.652926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:31.655432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:31.656380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:31.660291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a1a4-d5c1-4561-9f2c-789b40f7c1a8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:31.699874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:31.700106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:31.701528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.702020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.702514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.716870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:31.727080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:31.728249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:31.729009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:31.731340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:31.732405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:31.783103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0ade-7a08-4ffc-8542-9e99a30d1dac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:31.805326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:31.819316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:31.820157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.820446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.820724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.831302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:31.839604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:31.840532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:31.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:31.842370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:31.856618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f848a9-2caf-4085-808e-0b00775048fb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:31.889149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:31.889816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.890103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.890381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.891133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:31.891445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:31.892896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8af64-a488-4d18-a5d7-2356c812574c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:31.901360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:31.902394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acd360-2565-4eaa-a330-0e362ec2ad68 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.902683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acd360-2565-4eaa-a330-0e362ec2ad68 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.902964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acd360-2565-4eaa-a330-0e362ec2ad68 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.904372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 36/72] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:31.904932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acd360-2565-4eaa-a330-0e362ec2ad68 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:31.939417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:31.949651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb2fe9-2058-4db2-aeb9-460a2dfcc0d1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:31.983227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:31.983943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.984238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.984533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.985292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:31.985614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:31.987033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976101-33d1-4e83-844d-d5b79baf5675 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:31.995069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:31.997273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf38f-dd74-4235-b762-8edc000e5c5e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:31.997575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf38f-dd74-4235-b762-8edc000e5c5e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:31.997857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf38f-dd74-4235-b762-8edc000e5c5e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:31.999552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 38/74] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:32.000117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf38f-dd74-4235-b762-8edc000e5c5e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.005333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acd360-2565-4eaa-a330-0e362ec2ad68 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.025559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.041011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.041687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.041979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.042262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.043018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:32.043335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.044760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d380442-88f7-4c9a-897e-e500e6e75eca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.053590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:32.054785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6134-e23b-4879-a39c-f7578dc6fb03 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.055077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6134-e23b-4879-a39c-f7578dc6fb03 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.055421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6134-e23b-4879-a39c-f7578dc6fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.071623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c6db6134-e23b-4879-a39c-f7578dc6fb03 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:32.072867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c6db6134-e23b-4879-a39c-f7578dc6fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:32.109054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf38f-dd74-4235-b762-8edc000e5c5e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.143094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.143711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:32.144001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.144294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.144577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.145148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.145400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.145692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.163431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.164936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.166684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:31 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:32.167450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.168510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:32.169724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:32.179592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.243866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:32.243866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.265888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfaec-50ad-4e57-97e2-2c9810d4aa9c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.278347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.302210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.303138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.303429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.303712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.304981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.306485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.308113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:32.308900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.335399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0903a-8e80-43a4-a73d-490e0cc5edc9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.368500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.369360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.369657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.369940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.371148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.372665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.374318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:32.375169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.386480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.408165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce92a02-8502-4644-b9f3-ac680c39b71d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.447902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.448745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.449043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.449327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.460223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:32.467947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:32.468795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:32.469548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:32.470187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.479008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df2c29-5990-40b2-ab55-41d91ee0ed6f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.489572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.514681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.515331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.515618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.515936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.572571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb11f4-3246-404c-95cb-26d994238263 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.580408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.581879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.606517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.607311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.607604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.607917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.609122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.610645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.612271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 42/82] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:32.613072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.622256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.684582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 41/83] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:32.685436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.696605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.718271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b9079-0138-41df-a0ca-bbac474d75f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.751803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.752488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.752775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.753057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.789636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93c55-befe-45cd-aa8b-e3112b1724ce None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:32.821197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.822317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:32.822750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.822969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:32.823262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:32.823549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:32.830435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.891847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:32.893344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:32.905199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:32.923193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 43/84] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:32.928653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:32.997153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 42/85] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:32.997988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.027330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf2f54-f816-483e-86e5-650a4fd924d9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.034582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:33.062154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.062825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.063116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.063399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.064191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:33.064509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.065919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.074512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 44/86] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.075245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.094502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024247-d1ff-426b-ae7c-28bee3405659 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.105261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:33.132889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.133830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.134122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.134410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.135147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.136719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.156533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 43/87] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:32 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:33.168193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.179857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037b28b-34fd-448f-86ce-8c4729292043 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.218686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.219577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.219897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.220188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.221745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.223260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.231023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 45/88] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.231923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.270727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:33.272723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b351-a4ee-48c3-9add-2f951a965b05 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.312383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.313263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.313581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.313870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.315097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.316595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.318391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 44/89] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.319329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.353156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f144b-5fa0-4c37-8992-43bf0d4c5c58 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.357366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:33.403200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.404119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.404468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.404725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.406969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.408387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.410310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 46/90] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.410931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.445799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1a859-ab87-4520-be22-a4d1257f891a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.490570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.492539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.493284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.493759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.496057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.497728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.504827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.505786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.546756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b09f-2128-4e86-aa43-3f690c8317b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.556371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:33.594955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.595617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.595930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.596214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.597056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] RBAC: Adding query filter params (role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=9ac0478d443a4d67a025ec84737cdba0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:33.597375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.599086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.604956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/role_assignments?user.id=9ac0478d443a4d67a025ec84737cdba0&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.605719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.635674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d873-2070-443a-84b5-73684d07ffc0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.638928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:33.687526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.688584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.689662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.690162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.691752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=9ac0478d443a4d67a025ec84737cdba0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:33.692389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.695700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.707760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/role_assignments?user.id=9ac0478d443a4d67a025ec84737cdba0&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=fde1ffae211846158ce1303a9da8610d => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.709304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:33.723285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919787-79a7-4e68-b57f-8ec6f6192c6f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.781021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.781708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.781997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.782291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.783262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=2a54999c7536405a8d0c6aa5dc9fba82) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:33.783581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:33.788128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:33.804751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/role_assignments?user.id=2a54999c7536405a8d0c6aa5dc9fba82&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:33.895294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b129-1dd6-4122-8693-dd33445a07bb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:33.945778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:33.946807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:33.947326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:33.947848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:33.993542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:34.055927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:34.058037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:34.200897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 47/95] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:34.206127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:34.249551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:34.325129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0683f-498a-420e-a5c2-4b3ad1d13262 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:34.373561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8e1f7-16d4-4c8d-9015-2819609bf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:34.375105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8e1f7-16d4-4c8d-9015-2819609bf088 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:34.375534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8e1f7-16d4-4c8d-9015-2819609bf088 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:34.375976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8e1f7-16d4-4c8d-9015-2819609bf088 None admin] PATH_INFO: `/v3/projects/a33608525a484093ab43f436845b754d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:34.377365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8e1f7-16d4-4c8d-9015-2819609bf088 None admin] RBAC: Authorizing `identity:get_project(project_id=a33608525a484093ab43f436845b754d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:34.378974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8e1f7-16d4-4c8d-9015-2819609bf088 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:34.381502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:34 2022] GET /identity/v3/projects/a33608525a484093ab43f436845b754d => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:34.387570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:34.477615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:34.517809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb003d2-bf2b-4ebb-b5fc-950756929ff8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:34.561784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:34.562459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:34.562753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:34.563042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:34.563919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=a33608525a484093ab43f436845b754d, user.id=9ac0478d443a4d67a025ec84737cdba0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:34.564248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:34.565805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fbefb-87f5-495f-ba4d-b3a88f440907 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:34.575911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:34 2022] GET /identity/v3/role_assignments?user.id=9ac0478d443a4d67a025ec84737cdba0&scope.project.id=a33608525a484093ab43f436845b754d&role.id=fde1ffae211846158ce1303a9da8610d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:35.937877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0b3b-15af-4371-a2de-e0c6160726d5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:35.938903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0b3b-15af-4371-a2de-e0c6160726d5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:35.939401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0b3b-15af-4371-a2de-e0c6160726d5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:35.941067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:35.947217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:35.948132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:35.948625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:35.972831 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:35.974925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:36.058876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 49/99] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:36.082379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa0b3b-15af-4371-a2de-e0c6160726d5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:36.215093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:36.219427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa0b3b-15af-4371-a2de-e0c6160726d5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:36.263042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:36.263869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.264170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.264451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.277927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:36.285596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:36.286448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:36.287762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 51/100] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:36.293363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:36.367623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:36.413688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b42f8-df7f-4836-a267-8edafaaf1fca None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:36.448205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:36.448879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.449172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.449450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.450210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:36.450520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:36.451925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf68326-2daa-4c05-a3c0-64dfc6e14328 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:36.461166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 50/101] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:36.466640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:36.510692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0729d-0773-4fae-b52a-0fb9a455ee2f None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.510983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0729d-0773-4fae-b52a-0fb9a455ee2f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.511260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0729d-0773-4fae-b52a-0fb9a455ee2f None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.512799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 51/102] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:36.518961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.519248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.519525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.543184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:36.544391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:36.653727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 52/103] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:36.686069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712856-d48c-4f82-bd89-835d77ebaf55 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:36.696599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:36.759106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94528d-dcf0-4e84-976d-5deb4af72bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:36.760086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94528d-dcf0-4e84-976d-5deb4af72bfd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.760381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94528d-dcf0-4e84-976d-5deb4af72bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.760663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94528d-dcf0-4e84-976d-5deb4af72bfd None admin] PATH_INFO: `/v3/users/b00d727d97f443b29dd19dce33f36198` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.771495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:36.781719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94528d-dcf0-4e84-976d-5deb4af72bfd None admin] RBAC: Authorizing `identity:get_user(user_id=b00d727d97f443b29dd19dce33f36198)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:36.784198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94528d-dcf0-4e84-976d-5deb4af72bfd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:36.786092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 52/104] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:36 2022] GET /identity/v3/users/b00d727d97f443b29dd19dce33f36198 => generated 289 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:36.788412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde45f-032b-4971-a214-399b5114736a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.788859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde45f-032b-4971-a214-399b5114736a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.789282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde45f-032b-4971-a214-399b5114736a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.790789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 53/105] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:36.792192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e768a9-cc13-4712-9fcb-3f1248c7df77 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.792724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e768a9-cc13-4712-9fcb-3f1248c7df77 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.793182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e768a9-cc13-4712-9fcb-3f1248c7df77 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.799069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 54/106] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:36.800587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec552222-b235-4458-bdfb-7217fb399c4a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.801026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec552222-b235-4458-bdfb-7217fb399c4a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.801499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec552222-b235-4458-bdfb-7217fb399c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.820669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ec552222-b235-4458-bdfb-7217fb399c4a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:36.821629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bcc1e-8248-4eeb-b626-3e9a494383de None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:36.822348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ec552222-b235-4458-bdfb-7217fb399c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:36.837253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:36.867569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:36.868937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.869230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.869499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.883704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:36.895028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:36.896295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 53/107] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:36.897168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:36.906157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 55/108] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:36.908359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:36.908805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:36.909232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:36.945134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:36.946490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:37.015452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 56/109] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:37.016487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.018215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456a59d-b4a5-443a-bc5c-309d7103d010 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.032514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.057062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.057977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.058548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.058970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.099686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.123494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f503d-0f50-4b82-b389-11f5404f9e71 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.139099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.140863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.159207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.159876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.160202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.160446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.161206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:37.161694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.163048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.176263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 57/110] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.177168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.258230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 54/111] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:37.259500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.275312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.281053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fee96f-e366-49a0-8352-c3780af33507 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.318149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.319066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.319336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.319627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.327903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.331260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:37.341016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:37.341896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:37.342629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 58/112] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:37.343248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.373038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9b025-45ca-4c44-9c6e-ad18b1220192 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.409771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.410490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.410781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.411067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.412901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.414501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.416461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 55/113] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.417187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.450325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4cf5-6666-44b2-a33e-d87a52f314c8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.490848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762a78-220d-49ee-b90a-c6917faa58e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.491738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762a78-220d-49ee-b90a-c6917faa58e3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.492062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762a78-220d-49ee-b90a-c6917faa58e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.492340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762a78-220d-49ee-b90a-c6917faa58e3 None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.493573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762a78-220d-49ee-b90a-c6917faa58e3 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.495029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762a78-220d-49ee-b90a-c6917faa58e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.501131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.501131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9009b39-43a5-41d9-9928-d0a1879af96d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.501131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9009b39-43a5-41d9-9928-d0a1879af96d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.501131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9009b39-43a5-41d9-9928-d0a1879af96d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.501131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 60/115] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:37.501131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9009b39-43a5-41d9-9928-d0a1879af96d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.520537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.546134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812834f2-4f32-407c-b15f-44dd8189bab8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.574580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.583211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.584169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.584440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.585153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.586363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.588225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.589942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 56/116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.590682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.610393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9009b39-43a5-41d9-9928-d0a1879af96d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.645774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.647107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.647390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.647667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.648462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:37.648770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.650159 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.657883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 61/117] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.658723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.694804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c275-9bd1-4a88-88cb-0fa2b5640145 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.727941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148fbfd-5a68-4b89-b486-dd950e09436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.728620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fbfd-5a68-4b89-b486-dd950e09436d None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.728914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fbfd-5a68-4b89-b486-dd950e09436d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.729201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fbfd-5a68-4b89-b486-dd950e09436d None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.729921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fbfd-5a68-4b89-b486-dd950e09436d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.731379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fbfd-5a68-4b89-b486-dd950e09436d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.751364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.754658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b4623-92c0-4a63-b3aa-dc8bed3c1bbc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.760138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 57/118] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:24:37 2022] POST /identity/v3/projects => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:37.761378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.761672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.761947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.784517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:37.785778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:37.796291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:37.803943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e6530-abde-462d-b872-c915800f2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.804839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e6530-abde-462d-b872-c915800f2d71 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.805125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e6530-abde-462d-b872-c915800f2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.805410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e6530-abde-462d-b872-c915800f2d71 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.807106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e6530-abde-462d-b872-c915800f2d71 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.808739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e6530-abde-462d-b872-c915800f2d71 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.815568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 62/119] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.815568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d79a-52d3-4b63-864e-264d1a2c75da None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.815568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d79a-52d3-4b63-864e-264d1a2c75da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.815568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d79a-52d3-4b63-864e-264d1a2c75da None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.815568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 63/120] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:37.815568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d79a-52d3-4b63-864e-264d1a2c75da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.870562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 58/121] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:37.884885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:37.934428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d79a-52d3-4b63-864e-264d1a2c75da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:37.972963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:37.973585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:37.973816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:37.974128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:37.975092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] RBAC: Adding query filter params (role.id=9c05b0960e064efd8ac51a8cc9c26ad2, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=b00d727d97f443b29dd19dce33f36198) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:37.975463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:37.977167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:37.983420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 64/122] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/role_assignments?user.id=b00d727d97f443b29dd19dce33f36198&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=9c05b0960e064efd8ac51a8cc9c26ad2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:37.984219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.009841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484ee6-fc8a-4996-b42c-fa3402391dbd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.054983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:38.064312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:38.067252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2addcb-0967-42a0-993b-98121ec58ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.068893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2addcb-0967-42a0-993b-98121ec58ffb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.069447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2addcb-0967-42a0-993b-98121ec58ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.069872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2addcb-0967-42a0-993b-98121ec58ffb None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.073089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2addcb-0967-42a0-993b-98121ec58ffb None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:38.075234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2addcb-0967-42a0-993b-98121ec58ffb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:38.078899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:37 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:38.080458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.080892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.081312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.105387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:38.107946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:38.113098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7500fc-4c11-48d3-8f1c-52c0ad6877fc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.168428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.169378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.169662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.169945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322/users/9ac0478d443a4d67a025ec84737cdba0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.172176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e18d972836416e8f3752123e2d3322, user_id=9ac0478d443a4d67a025ec84737cdba0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:38.174189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:38.196070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 65/124] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:37 2022] PUT /identity/v3/projects/62e18d972836416e8f3752123e2d3322/users/9ac0478d443a4d67a025ec84737cdba0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:38.200856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.219590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 60/125] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:38.220659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.355497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2df18-8187-4dd0-affd-818a99f7cc23 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.385298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:38.398239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.399283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.399726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.400185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.413387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:38.426261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:38.427893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:38.428888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:38.431198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 66/126] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:38.432693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.528356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3bcc7-57a6-41df-b96d-5047b8773050 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.560227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:38.570969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.572400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.572805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.573186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.574648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:38.576366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:38.578367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 61/127] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:38.579673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.588984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64e921-1061-4d7b-b124-382768650956 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.661334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.663063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.663500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.663951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.691449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa74b7-a4df-4022-a12b-2f2447dc8224 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.692573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:38.709351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:38.710435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:38.711390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:38.713972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 67/128] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:38.714968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.731823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.732668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.733377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.733765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.734910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:38.735323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:38.737873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:38.752632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 62/129] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:38.752632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.778525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:38.824828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:38.872840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6839c02-c8ad-4cb3-9fcb-7ba0ac3c1a9b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.876213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f53d5-a7ec-4b0d-8a61-bcca8a9d91ca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:38.936075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.937006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.938528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.939659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.940617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:38.941451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:38.945304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:38.948210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:38.949270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:38.949871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:38.951172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322/users/9ac0478d443a4d67a025ec84737cdba0/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:38.956427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] RBAC: Authorizing `identity:create_grant(project_id=62e18d972836416e8f3752123e2d3322, user_id=9ac0478d443a4d67a025ec84737cdba0, role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:38.958181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:38.964673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 63/130] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:38.965857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:38.989541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 68/131] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:38 2022] PUT /identity/v3/projects/62e18d972836416e8f3752123e2d3322/users/9ac0478d443a4d67a025ec84737cdba0/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:38.991329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:39.112242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2d39-cc5e-4e66-a647-bf4e7d708d62 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:39.118357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87a8eb-ab0c-4db2-a318-c90abebdae8f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:39.120276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:39.137011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:39.155438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:39.157051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:39.157572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:39.158049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:39.160262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:39.162325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:39.165624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 64/132] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:39.170425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:39.170883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:39.172002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:39.172736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:39.173489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:39.175869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:39.178378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:39.182045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 69/133] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:38 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:39.200264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:39.295891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0603-cdd7-4f26-b77e-a1efd763cf28 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:39.326950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:39.327934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:39.328131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:39.328413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:39.331855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:39.331855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:39.335107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 65/134] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:39 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:39.339723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:39.365910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a13e-2dea-45b4-9f76-21a8e104ab96 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:39.402991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:39.419296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:39.420485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:39.420951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:39.421404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] PATH_INFO: `/v3/projects/a33608525a484093ab43f436845b754d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:39.422782 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] RBAC: Authorizing `identity:get_project(project_id=a33608525a484093ab43f436845b754d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:39.424545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:39.427722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 70/135] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:39 2022] GET /identity/v3/projects/a33608525a484093ab43f436845b754d => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:39.436775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:39.461260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf55e8-2ae4-4b4f-a913-500c6baeb1b2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:39.496938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42997a9c-496f-4f58-96e0-2ea94c7ccd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:39.497896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997a9c-496f-4f58-96e0-2ea94c7ccd40 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:39.498189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997a9c-496f-4f58-96e0-2ea94c7ccd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:39.498474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997a9c-496f-4f58-96e0-2ea94c7ccd40 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322/users/2a54999c7536405a8d0c6aa5dc9fba82/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:39.500155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:39.501787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42997a9c-496f-4f58-96e0-2ea94c7ccd40 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e18d972836416e8f3752123e2d3322, user_id=2a54999c7536405a8d0c6aa5dc9fba82, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:39.503493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42997a9c-496f-4f58-96e0-2ea94c7ccd40 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:39.523730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 66/136] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:39 2022] PUT /identity/v3/projects/62e18d972836416e8f3752123e2d3322/users/2a54999c7536405a8d0c6aa5dc9fba82/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:39.611636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c13f5-9635-4efd-9e30-6fe453183e8f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:39.663453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf199e-eb4d-4035-98a0-79543847c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:39.664422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf199e-eb4d-4035-98a0-79543847c861 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:39.664719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf199e-eb4d-4035-98a0-79543847c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:39.665007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf199e-eb4d-4035-98a0-79543847c861 None admin] PATH_INFO: `/v3/projects/a33608525a484093ab43f436845b754d/users/9ac0478d443a4d67a025ec84737cdba0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:39.667732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf199e-eb4d-4035-98a0-79543847c861 None admin] RBAC: Authorizing `identity:create_grant(project_id=a33608525a484093ab43f436845b754d, user_id=9ac0478d443a4d67a025ec84737cdba0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:39.669260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf199e-eb4d-4035-98a0-79543847c861 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:39.710487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 71/137] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:39 2022] PUT /identity/v3/projects/a33608525a484093ab43f436845b754d/users/9ac0478d443a4d67a025ec84737cdba0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:40.729369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df16f-0852-44c4-ba36-a3e81f59519b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:40.730507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df16f-0852-44c4-ba36-a3e81f59519b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:40.731018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df16f-0852-44c4-ba36-a3e81f59519b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:40.732920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 67/138] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:40.738654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bfe1b-273d-4e61-b958-a65e1f40e221 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:40.739505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bfe1b-273d-4e61-b958-a65e1f40e221 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:40.740634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bfe1b-273d-4e61-b958-a65e1f40e221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:40.759000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-607bfe1b-273d-4e61-b958-a65e1f40e221 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:40.760589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-607bfe1b-273d-4e61-b958-a65e1f40e221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:40.834002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:40.856388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12df16f-0852-44c4-ba36-a3e81f59519b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:40.964167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12df16f-0852-44c4-ba36-a3e81f59519b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:40.986473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:40.993748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422736-e05c-461d-8dae-407226c1a4c6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:40.994056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422736-e05c-461d-8dae-407226c1a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:40.994340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422736-e05c-461d-8dae-407226c1a4c6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:40.995874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 73/140] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:41.004562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.004850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.005218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.027513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:41.028729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:41.035886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:41.036724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.037011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.037289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.058697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:41.066543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:41.067408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:41.068898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:41.071905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 68/141] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:41.084144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:41.089250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:41.133382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 74/142] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 18:24:41.159792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:41.265545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798fb1-98f3-4d54-a4d2-097630797c8e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:41.298080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd0649-c88a-42e4-98c4-9d2cd4a2cfd6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:41.301685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22fd5-cba3-4505-b951-a202310a0b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:41.302723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22fd5-cba3-4505-b951-a202310a0b10 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.303162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22fd5-cba3-4505-b951-a202310a0b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.303591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22fd5-cba3-4505-b951-a202310a0b10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.305079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22fd5-cba3-4505-b951-a202310a0b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:41.307145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22fd5-cba3-4505-b951-a202310a0b10 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:41.309272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 75/143] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:41.315220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310989-bdfa-43ab-bdfe-4453df841c14 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.315789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310989-bdfa-43ab-bdfe-4453df841c14 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.316251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310989-bdfa-43ab-bdfe-4453df841c14 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.319138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 76/144] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:41.320315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f310989-bdfa-43ab-bdfe-4453df841c14 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:41.353525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:41.413195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:41.414448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.414878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.415270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.416484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:41.416617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:41.418070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8b516-ef3d-429a-8e55-7bdf2b508d7d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:41.438826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f310989-bdfa-43ab-bdfe-4453df841c14 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:41.442371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 69/145] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:41.443491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.443790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.447961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.485149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:41.487573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:41.492310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:41.493162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.493589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.494071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.494942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:41.500272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:41.555232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:41.556469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 77/146] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:41 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:41.565337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:41.696316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:41.701739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 70/147] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:41.740774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38afe4-4fab-4435-91c0-09b888e5f930 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:41.741548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:41.828751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:41.829921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:41.830203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:41.830670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] PATH_INFO: `/v3/users/b00d727d97f443b29dd19dce33f36198` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:41.832033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] RBAC: Authorizing `identity:get_user(user_id=b00d727d97f443b29dd19dce33f36198)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:41.833660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:41.835321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 78/148] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:41 2022] GET /identity/v3/users/b00d727d97f443b29dd19dce33f36198 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:41.841592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:41.967436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0cf71-9e2d-4b62-9a07-be5d2190b405 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.004024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.004951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.005834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.006792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.008338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:42.009817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:42.011787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 79/149] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:41 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:42.017136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:42.039560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:42.046118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174569-f7ba-4a76-991c-fabeaad75cd5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.129079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22e63-d4c5-4d1b-9d48-ad3e6f47b33e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.133806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.134621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.134907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.135188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.165888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:42.168698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69306cf-447d-4553-adda-f08de20d3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.169600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69306cf-447d-4553-adda-f08de20d3044 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.169888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69306cf-447d-4553-adda-f08de20d3044 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.170167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69306cf-447d-4553-adda-f08de20d3044 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322/users/b00d727d97f443b29dd19dce33f36198/roles/9c05b0960e064efd8ac51a8cc9c26ad2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.172234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69306cf-447d-4553-adda-f08de20d3044 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e18d972836416e8f3752123e2d3322, user_id=b00d727d97f443b29dd19dce33f36198, role_id=9c05b0960e064efd8ac51a8cc9c26ad2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:42.173725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69306cf-447d-4553-adda-f08de20d3044 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:42.173918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:42.174731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:42.176633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 71/150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:42.181987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:42.203078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 80/151] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:42 2022] PUT /identity/v3/projects/62e18d972836416e8f3752123e2d3322/users/b00d727d97f443b29dd19dce33f36198/roles/9c05b0960e064efd8ac51a8cc9c26ad2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:42.228081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:42.310345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10e9b-dc00-47f8-8a88-922a894b187d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.328630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d96c-d241-409c-9f56-4f8271d4d0d5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.328956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d96c-d241-409c-9f56-4f8271d4d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.329506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d96c-d241-409c-9f56-4f8271d4d0d5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.331366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 81/152] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:42.341568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720fee-75f0-41e1-a2c9-a6d95adcb0b4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.341977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720fee-75f0-41e1-a2c9-a6d95adcb0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.342332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720fee-75f0-41e1-a2c9-a6d95adcb0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.371753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-91720fee-75f0-41e1-a2c9-a6d95adcb0b4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:42.373017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91720fee-75f0-41e1-a2c9-a6d95adcb0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:42.376608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.377303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.377588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.377867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.378647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:42.378959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:42.381370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:42.398222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 72/153] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:42.404030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:42.520173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 82/154] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:42.522783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562b2d-761d-4c9f-9809-841ccbbc5c11 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.523081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562b2d-761d-4c9f-9809-841ccbbc5c11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.523356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562b2d-761d-4c9f-9809-841ccbbc5c11 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.524728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 83/155] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:42.531408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.531695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.532010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.556931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:42.561925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:42.563601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:42.566525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:42.568371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7ac1b-3822-40e4-a914-ee962f3a090a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.634078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.634947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.635234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.635508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.636764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:42.638239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:42.640374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 73/156] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:42 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:42.641155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:42.680788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 84/157] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:42.681830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:42.804030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42930ffe-5a13-4a39-87e6-62b335026679 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.855079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49542459-e158-4b2b-b507-f63e144363c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.855733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542459-e158-4b2b-b507-f63e144363c0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.856050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542459-e158-4b2b-b507-f63e144363c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.856322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542459-e158-4b2b-b507-f63e144363c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.865359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:42.868493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e981-8065-4e91-b032-c4c010faef7c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:42.931553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:42.933395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:42.934250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:42.934763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:42.956529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:42.966774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:42.967807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:42.968633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:42.972172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 74/158] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:24:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:42.973408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:42.997333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:43.000956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49542459-e158-4b2b-b507-f63e144363c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:43.002494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49542459-e158-4b2b-b507-f63e144363c0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:43.090907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b098-66b1-47c9-905e-0573d8f79c81 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:43.131294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c36396-d037-47de-acaa-ed699bf36ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:43.132134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36396-d037-47de-acaa-ed699bf36ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.132423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36396-d037-47de-acaa-ed699bf36ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.132700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36396-d037-47de-acaa-ed699bf36ad0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.160821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c36396-d037-47de-acaa-ed699bf36ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-27c36396-d037-47de-acaa-ed699bf36ad0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:43.169051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:43.169928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:43.170808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:43.176840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 75/159] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:43.178906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5ac4-c93a-441a-9842-2876df84c8fa None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.179194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5ac4-c93a-441a-9842-2876df84c8fa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.179471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5ac4-c93a-441a-9842-2876df84c8fa None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.181073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 76/160] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:43.181891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5ac4-c93a-441a-9842-2876df84c8fa None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:43.215424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 85/161] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:43.216810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.217216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.217718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.260935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:43.262156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:43.328346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:43.366672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:43.402255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5ac4-c93a-441a-9842-2876df84c8fa None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:43.420193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 86/162] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:43.421052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:43.467152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:43.467745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.468054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.468328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.469082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:43.469389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:43.470761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:43.486084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 77/163] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:24:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:43.486891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:43.629764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b828d-6bb1-4d51-866c-403bf597f7ca None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:43.689475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:43.690155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.690442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.690759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.691482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:43.691794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:43.693743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:43.701974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713d04c-7372-47f9-a38e-967bcaf1ba26 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:43.707053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 87/164] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:43.707927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:43.761558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:43.797693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:43.798575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.798858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.799134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.804753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:43.806244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:43.808081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 78/165] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:43 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:43.808851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:43.834264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:43.876416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f11efb-f3f9-4fa2-ba01-695c9b2300d2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:43.932563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:43.933374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:43.933660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:43.933935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:43.949214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:43.965208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:43.966140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 88/166] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:43.968175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:43.990186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea060-807f-4388-84fe-4b6eb6529c0f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:44.068047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:44.070396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:44.072815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:44.080446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:44.084335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:44.086568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:44.091024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 79/167] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:43 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:44.094093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:44.154546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:44.174639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5e6a-2ecd-44cb-a283-d932a9000303 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:44.231344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:44.241667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:44.242564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:44.242849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:44.243131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] PATH_INFO: `/v3/users/9ac0478d443a4d67a025ec84737cdba0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:44.244591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] RBAC: Authorizing `identity:get_user(user_id=9ac0478d443a4d67a025ec84737cdba0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:44.246068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:44.247926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 89/168] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:43 2022] GET /identity/v3/users/9ac0478d443a4d67a025ec84737cdba0 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:44.248501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:44.261712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30922f7f-6ea4-471d-8620-29b5ade5cf89 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:44.306964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:44.308018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:44.308589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:44.309094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:44.310200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=9ac0478d443a4d67a025ec84737cdba0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:44.310751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:44.312514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:44.327096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 80/169] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:44 2022] GET /identity/v3/role_assignments?user.id=9ac0478d443a4d67a025ec84737cdba0&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=fde1ffae211846158ce1303a9da8610d => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:44.328431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:44.368666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b57bba-0697-48ed-a21f-62ec2304535b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:44.420585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:44.421283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:44.421576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:44.421854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:44.422627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:44.422943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:44.424397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:44.438332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 90/170] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:44.439227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:44.485430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:44.511920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab9d5b-f48f-45b4-a607-a9ae4dc617f0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:44.576591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:44.577332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:44.577557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:44.577833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:44.606098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:44.615790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20e36-efa5-4880-9952-0f703732c934 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:44.681531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:44.682195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:44.682482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:44.682761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:44.694776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:44.696309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:44.789649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:44.791152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:44.823265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:44.846593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 81/171] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:44.847369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:44.900193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:44.939674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 91/172] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:44.940655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:44.986003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c471e8-b409-42f2-814f-f2bb07469895 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.044574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.045478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.045756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.046029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] PATH_INFO: `/v3/users/2a54999c7536405a8d0c6aa5dc9fba82` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.047285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=2a54999c7536405a8d0c6aa5dc9fba82)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.048768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.050420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 82/173] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:44 2022] GET /identity/v3/users/2a54999c7536405a8d0c6aa5dc9fba82 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:45.051189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:45.071974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d371dfa-3b9f-479d-82bf-43b52c7dbc0d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.093730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:45.124651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.125455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.125742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.126020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.127285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.128787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.131131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 92/174] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:44 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:45.131945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:45.205247 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bfe5a-e709-4e26-8077-8bf32a644bf2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.222852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:45.302865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.303752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.304060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.304336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] PATH_INFO: `/v3/projects/a33608525a484093ab43f436845b754d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.307115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] RBAC: Authorizing `identity:get_project(project_id=a33608525a484093ab43f436845b754d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.308600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.310639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 83/175] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:45 2022] GET /identity/v3/projects/a33608525a484093ab43f436845b754d => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:45.311425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:45.355359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704836b-4d7c-4fac-a631-cf4268eb069f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.432703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f56b-e36f-47a0-a609-82f74973398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.433305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f56b-e36f-47a0-a609-82f74973398c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.433594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f56b-e36f-47a0-a609-82f74973398c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.433873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f56b-e36f-47a0-a609-82f74973398c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.497816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929270b-ce9e-4044-a367-2dee12d610f5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.566941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.567640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.567970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.568242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.569267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] RBAC: Adding query filter params (role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=9ac0478d443a4d67a025ec84737cdba0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:45.569580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.571077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.576204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:45.577301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 84/176] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:45 2022] GET /identity/v3/role_assignments?user.id=9ac0478d443a4d67a025ec84737cdba0&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:45.585308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:45.587647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f56b-e36f-47a0-a609-82f74973398c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.589436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f56b-e36f-47a0-a609-82f74973398c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.714730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 93/177] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:45.716419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942abef-9e55-480e-9450-ec936f22988d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.717061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942abef-9e55-480e-9450-ec936f22988d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.717514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942abef-9e55-480e-9450-ec936f22988d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.719476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 94/178] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:45.720974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d656-e228-42b9-9a71-e15949df2e85 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.721476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d656-e228-42b9-9a71-e15949df2e85 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.721961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d656-e228-42b9-9a71-e15949df2e85 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.723613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 95/179] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:45.725108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465d656-e228-42b9-9a71-e15949df2e85 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:45.746396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:45.854191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:45.870876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465d656-e228-42b9-9a71-e15949df2e85 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.871062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f860-2564-42d7-9450-dad03e81d6a9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:45.908486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.909139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.909423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.909699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.910134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a89c-ce2b-4e86-b717-931327b25af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:45.910532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=a33608525a484093ab43f436845b754d, user.id=9ac0478d443a4d67a025ec84737cdba0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:45.910847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.910997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a89c-ce2b-4e86-b717-931327b25af9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.911908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a89c-ce2b-4e86-b717-931327b25af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.912645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a89c-ce2b-4e86-b717-931327b25af9 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.913025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f203-984f-452e-a5b0-2858662cb5a6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.913846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5a89c-ce2b-4e86-b717-931327b25af9 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:45.915296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5a89c-ce2b-4e86-b717-931327b25af9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:45.917262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 96/180] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:45 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:45.918183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6be5-40ac-4852-bd5b-c0bb346a827c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.918471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6be5-40ac-4852-bd5b-c0bb346a827c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.918750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6be5-40ac-4852-bd5b-c0bb346a827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.922012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 85/181] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:45 2022] GET /identity/v3/role_assignments?user.id=9ac0478d443a4d67a025ec84737cdba0&scope.project.id=a33608525a484093ab43f436845b754d&role.id=fde1ffae211846158ce1303a9da8610d => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:45.923050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc365ea-f08e-4ddc-bd65-c8f9b514b747 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:45.923342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc365ea-f08e-4ddc-bd65-c8f9b514b747 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:45.923619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc365ea-f08e-4ddc-bd65-c8f9b514b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:45.937296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-40cf6be5-40ac-4852-bd5b-c0bb346a827c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:45.938542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-40cf6be5-40ac-4852-bd5b-c0bb346a827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:45.942192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2cc365ea-f08e-4ddc-bd65-c8f9b514b747 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:45.943557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2cc365ea-f08e-4ddc-bd65-c8f9b514b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:46.018203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 97/182] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:46.019593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420a1f-9b17-4dc9-9ddb-7a46ca04d9ec None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.019913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420a1f-9b17-4dc9-9ddb-7a46ca04d9ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.020201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420a1f-9b17-4dc9-9ddb-7a46ca04d9ec None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.022537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 98/183] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:46.023491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129773-051b-4e23-9304-f5024a266e9e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.023773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129773-051b-4e23-9304-f5024a266e9e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.024072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129773-051b-4e23-9304-f5024a266e9e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.029502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 99/184] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:46.029502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7129773-051b-4e23-9304-f5024a266e9e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.032380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 86/185] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:46.035010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2239f0-f93b-48c3-9b2f-0873aaf5315d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.035553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2239f0-f93b-48c3-9b2f-0873aaf5315d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.036077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2239f0-f93b-48c3-9b2f-0873aaf5315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.061457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ef2239f0-f93b-48c3-9b2f-0873aaf5315d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:46.063762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ef2239f0-f93b-48c3-9b2f-0873aaf5315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:46.093640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.134366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.142496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 87/186] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:46.143800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.144146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.145015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.158008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7129773-051b-4e23-9304-f5024a266e9e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.161276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:46.162539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:46.196464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.197125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.197418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.197698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.198540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=2a54999c7536405a8d0c6aa5dc9fba82) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:46.198858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:46.200356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:46.206213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 100/187] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/role_assignments?user.id=2a54999c7536405a8d0c6aa5dc9fba82&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:46.207072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.244493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 88/188] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:46.244493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.335733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f871d-75fc-4f76-9149-01f24b52fc60 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.365013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.372444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d609175-9daa-4de5-bbb0-36e60eb30dbe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.372742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.373912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.374424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.374819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.387321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:46.395518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:46.396701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:46.397479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 101/189] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:46.398217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.411768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.420335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.421400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.421400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.421562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.432357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:46.440517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:46.441418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:46.442207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 89/190] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:46.443381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.507299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69b055-071a-4762-977f-202ee282c4a2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.540183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.540972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.541259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.541358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28ac0-2eb2-4361-aa7e-8e0588f49032 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.541537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.542709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:46.544307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:46.545932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 102/191] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:46.546700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.574234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.575019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.575302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.575576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.585808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:46.593445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:46.594303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:46.595087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 90/192] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:46.595955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.614290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.632003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.653779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb7f7-6228-4db4-a80b-161edc58bf47 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.687451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.688135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.688418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.688693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.689438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:46.689744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:46.691119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:46.698886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 103/193] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:46.699647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.700269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858275c3-c502-40d5-bd15-5456f54970c9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.733436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.734094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.734377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.734652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.735403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:46.735712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:46.737161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:46.745800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 91/194] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:46.745800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.801590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e87a-5c6b-400c-9e53-1c9ab923aaad None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.825907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.835488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.836246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.836483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.836762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.837476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:46.838925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:46.848458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f85dc-5565-4bb8-b3f4-ff97e36d1e80 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:46.848623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:46.859823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 104/195] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:46 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:46.861017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:46.887207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:46.887944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:46.888237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:46.888520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:46.889302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:46.889617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:46.891053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:46.902186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 92/196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:46.903977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.010694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e677b-6233-4652-b3d4-2edd768de746 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.021294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4344-13d2-44e7-88cb-52e93b22302d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.057648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.058523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.058644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.059047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.059047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] PATH_INFO: `/v3/users/b00d727d97f443b29dd19dce33f36198` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.059492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.059770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.060159 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] PATH_INFO: `/v3/users/352176f40ecd408c92ebae8de5bcba04` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.060514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] RBAC: Authorizing `identity:get_user(user_id=b00d727d97f443b29dd19dce33f36198)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.062161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.065034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 93/197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/users/b00d727d97f443b29dd19dce33f36198 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:47.069669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.075915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=352176f40ecd408c92ebae8de5bcba04)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.077388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.079119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 105/198] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:46 2022] GET /identity/v3/users/352176f40ecd408c92ebae8de5bcba04 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:47.084294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.084696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:47.154297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:47.209737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d9b9-f577-4992-a87a-fefc2f550c13 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.213324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449938a0-c738-4ce9-b8ec-a5b933dad6e0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.247632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.248474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.248768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.249037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] PATH_INFO: `/v3/users/352176f40ecd408c92ebae8de5bcba04` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.260424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=352176f40ecd408c92ebae8de5bcba04)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.262131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.263497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.264446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.264975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.266885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 94/199] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/users/352176f40ecd408c92ebae8de5bcba04 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:47.267352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.268909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.361513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.363316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.448666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:47.481061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:47.524734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 106/200] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:47.525426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.526463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675ca7-1227-41a5-95c0-be046b817fb1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.575706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.576870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.577380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.577857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.704305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.706425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.729510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7b8b8-9ccd-49f5-8ae9-e73ce661897f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.784772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.785427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.785713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.785988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.811377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:47.813500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:47.839566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 95/201] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:47.844714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.864882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.866548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.949738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25867c1f-01c0-4839-94e9-6bbdd58dc99b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:47.984292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 107/202] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:47.985375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:47.987375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:47.988348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:47.988755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:47.989099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:47.991455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:47.993047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:47.994971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 96/203] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:47.995808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:48.045243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:48.055202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:48.112773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf427134-c67d-4365-909e-2d50040a4cd0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:48.121753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e4e07-2cd2-40f8-b41f-c706b6fccb3b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:48.158834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:48.159727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:48.160047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:48.160327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:48.162971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:48.164558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:48.166428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 108/204] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:48.167238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:48.172408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:48.173262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:48.173612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:48.173954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:48.175366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:48.177163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:48.182535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 97/205] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:47 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:48.182535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:48.287505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe72178-9e5a-4157-9fba-9c391d69de29 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:48.288920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af74b1-33b7-4a5b-ae3a-33c09f91d0f6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:48.298706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:48.313253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:48.326111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:48.326492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:48.326767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:48.327050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:48.327325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:48.327789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:48.328211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] RBAC: Adding query filter params (role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=88182820589348c0b422c66f88272a54, user.id=352176f40ecd408c92ebae8de5bcba04) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:48.328390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:48.328507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:48.328905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:48.329880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] RBAC: Adding query filter params (role.id=9c05b0960e064efd8ac51a8cc9c26ad2, scope.project.id=62e18d972836416e8f3752123e2d3322, user.id=b00d727d97f443b29dd19dce33f36198) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:48.329991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:48.330428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:48.332044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fac813-8761-46ef-b782-249ed7bb1deb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:48.336223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 98/206] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:48 2022] GET /identity/v3/role_assignments?user.id=352176f40ecd408c92ebae8de5bcba04&scope.project.id=88182820589348c0b422c66f88272a54&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:48.336999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:48.339937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 109/207] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:48 2022] GET /identity/v3/role_assignments?user.id=b00d727d97f443b29dd19dce33f36198&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=9c05b0960e064efd8ac51a8cc9c26ad2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:48.456207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a94bd-9695-4f1b-971f-e194d3900427 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:48.494520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:48.495194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:48.495478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:48.495755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:48.496635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=88182820589348c0b422c66f88272a54, user.id=352176f40ecd408c92ebae8de5bcba04) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:48.496949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:48.498425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f562fa3-6bf5-4f39-a145-739fff01b696 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:48.504964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 99/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:48 2022] GET /identity/v3/role_assignments?user.id=352176f40ecd408c92ebae8de5bcba04&scope.project.id=88182820589348c0b422c66f88272a54&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:49.187481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63b7e-713f-4a66-86e2-23e43acf2978 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.188535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63b7e-713f-4a66-86e2-23e43acf2978 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.189046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63b7e-713f-4a66-86e2-23e43acf2978 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.190954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 110/209] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:49.197035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.197964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.198681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.200772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c68-18e1-4b8f-879d-d108b1def09b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.201031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c68-18e1-4b8f-879d-d108b1def09b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.201312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c68-18e1-4b8f-879d-d108b1def09b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.202925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 111/210] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:49.207942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.208830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.209129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.220290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:49.221949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:49.227116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:49.228333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:49.257252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:49.307775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 100/212] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:49.316063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 112/212] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:49.327197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:49.333679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:49.438774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a22297-279a-4b72-a39e-d8bb63f08429 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:49.458976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:49.463792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307d669-d7d6-4e27-862f-59b27a083242 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:49.481811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:49.483093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.483582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.484092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.485721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:49.488404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:49.490917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 113/213] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:49.501438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:49.504452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:49.505781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.506059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.506334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.520524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:49.531686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:49.532600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:49.533385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 101/214] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:49.540158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:49.587489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:49.622397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748da416-7d83-46f6-b54c-c72194f35659 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:49.666846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:49.667781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.668109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.668388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.669482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:49.671044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:49.686975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91fc4-6c69-4185-9b50-b59912505af7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:49.708002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 114/215] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:49 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:49.739091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:49.740361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.740797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.741216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.742209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:49.742696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:49.744479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:49.754953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 102/216] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:49.761760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:49.832604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:49.878250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906a3b8-7225-41c8-bab0-ac6ded32f60e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:49.913620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:49.914727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:49.915157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:49.915661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] PATH_INFO: `/v3/users/9709aa875fea4522b569fa2895d30f7e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:49.930343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] RBAC: Authorizing `identity:get_user(user_id=9709aa875fea4522b569fa2895d30f7e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:49.932058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:49.933923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 115/217] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:49 2022] GET /identity/v3/users/9709aa875fea4522b569fa2895d30f7e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:49.939471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:50.038150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:50.049649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581db8-1d6c-46c6-9b21-a8ce303f0318 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:50.086322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:50.087212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.087638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.088075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.161939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:50.163685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:50.259311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:50.271087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 103/218] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:50.276530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:50.424243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:50.428519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdbdbd-a7ee-4f1b-b56e-c65bd230464c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:50.472630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e469ea9-dc44-48ab-8216-ab8f441306f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:50.473497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e469ea9-dc44-48ab-8216-ab8f441306f2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.474325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e469ea9-dc44-48ab-8216-ab8f441306f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.474825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e469ea9-dc44-48ab-8216-ab8f441306f2 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.476542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e469ea9-dc44-48ab-8216-ab8f441306f2 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:50.478008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e469ea9-dc44-48ab-8216-ab8f441306f2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:50.480055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 116/219] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:50 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:50.485733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:50.597444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8f40-497a-45da-9a99-a40c040d6263 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.597783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8f40-497a-45da-9a99-a40c040d6263 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.598096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8f40-497a-45da-9a99-a40c040d6263 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.599933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 117/220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:50.610978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a078f-f7d4-4217-9a5b-8fe3462f8976 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.610978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a078f-f7d4-4217-9a5b-8fe3462f8976 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.610978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a078f-f7d4-4217-9a5b-8fe3462f8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.615366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6385e-770d-48b8-ad61-e01d6198f45b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:50.636355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-655a078f-f7d4-4217-9a5b-8fe3462f8976 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:50.637872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-655a078f-f7d4-4217-9a5b-8fe3462f8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:50.661306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:50.662165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.662343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.662627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.663484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=88182820589348c0b422c66f88272a54, user.id=9709aa875fea4522b569fa2895d30f7e) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:50.663803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:50.665284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:50.680125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 104/221] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:50 2022] GET /identity/v3/role_assignments?user.id=9709aa875fea4522b569fa2895d30f7e&scope.project.id=88182820589348c0b422c66f88272a54&role.id=fde1ffae211846158ce1303a9da8610d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:50.732666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 118/222] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:50.766080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:50.850459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:50.901304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0104e37-7bc4-405c-b4a9-65d42f489fec None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:50.933276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01a0c-f2ca-4fc0-ac7a-f8c5151f5cea None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.933891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01a0c-f2ca-4fc0-ac7a-f8c5151f5cea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.934370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01a0c-f2ca-4fc0-ac7a-f8c5151f5cea None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.936143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 119/223] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:50.941666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.941953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.942236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.943969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:50.945137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:50.945697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:50.946174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:50.961205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:50.962454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:50.963664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:50.971177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:50.972073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:50.972882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:50.973484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 105/224] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:50.982363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.093893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 120/225] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:51.140194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf6ff7-81b8-491f-bf22-19231e029095 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.141784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.169180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:51.193798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:51.202653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:51.203338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:51.203630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:51.208496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:51.210169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:51.210756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:51.212494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:51.222399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 106/226] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:51.228689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.356474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8c3e-ff7a-48af-a15b-ad639010aa88 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.400830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e0f8-f59d-4cfa-8bda-312efbfc76b5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.415264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:51.416099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:51.416391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:51.416675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:51.434390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:51.450473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:51.451372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:51.452262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 121/227] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:51.457546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.469193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:51.470401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:51.470916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:51.471381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] PATH_INFO: `/v3/users/352176f40ecd408c92ebae8de5bcba04` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:51.472878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] RBAC: Authorizing `identity:get_user(user_id=352176f40ecd408c92ebae8de5bcba04)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:51.474652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:51.477388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 107/228] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:51 2022] GET /identity/v3/users/352176f40ecd408c92ebae8de5bcba04 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:51.483309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.537374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:51.619857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:51.637538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96b8c1-934b-4bf9-bd8c-387f64f372c0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.675479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:51.676337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:51.676657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:51.677016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:51.677783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:51.678100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:51.678351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff96dd-5b13-4573-8366-1fa7071539a0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.679513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:51.689606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 122/229] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:51.695795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.745854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:51.746685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:51.746974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:51.747250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:51.749492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:51.750972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:51.754370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 108/230] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:51 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:51.761016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.854221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a62dce-06d2-49df-aceb-c9a4083de551 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.894114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:51.894994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:51.895280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:51.895590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] PATH_INFO: `/v3/users/352176f40ecd408c92ebae8de5bcba04` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:51.897480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] RBAC: Authorizing `identity:get_user(user_id=352176f40ecd408c92ebae8de5bcba04)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:51.898947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:51.900631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 123/231] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:51 2022] GET /identity/v3/users/352176f40ecd408c92ebae8de5bcba04 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:51.908737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:51.945011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:51.965988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6bfbc-06c9-4a0c-988e-0064fcfc87f9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:51.992446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:52.033132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:52.034042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.034332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.034610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54/users/352176f40ecd408c92ebae8de5bcba04/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.040228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=88182820589348c0b422c66f88272a54, user_id=352176f40ecd408c92ebae8de5bcba04, role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:52.043323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:52.066345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 109/232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:51 2022] PUT /identity/v3/projects/88182820589348c0b422c66f88272a54/users/352176f40ecd408c92ebae8de5bcba04/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:52.089055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa752b-59cf-4da1-a991-b0d8bcaa7251 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:52.151158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b4184-d4da-4a44-9196-732c453bb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:52.152084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b4184-d4da-4a44-9196-732c453bb01b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.152372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b4184-d4da-4a44-9196-732c453bb01b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.152657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b4184-d4da-4a44-9196-732c453bb01b None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.154895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b4184-d4da-4a44-9196-732c453bb01b None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:52.156577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b4184-d4da-4a44-9196-732c453bb01b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:52.158654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 124/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:51 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:52.165271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:52.286911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f0c0-f9fa-4e62-99ca-73d06ccd20f6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:52.325325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da09b-d48b-48d7-bda4-54970382c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:52.326237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da09b-d48b-48d7-bda4-54970382c65c None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.326522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da09b-d48b-48d7-bda4-54970382c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.326795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da09b-d48b-48d7-bda4-54970382c65c None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54/users/352176f40ecd408c92ebae8de5bcba04/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.328851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da09b-d48b-48d7-bda4-54970382c65c None admin] RBAC: Authorizing `identity:create_grant(project_id=88182820589348c0b422c66f88272a54, user_id=352176f40ecd408c92ebae8de5bcba04, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:52.330336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da09b-d48b-48d7-bda4-54970382c65c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:52.351619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 110/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:52 2022] PUT /identity/v3/projects/88182820589348c0b422c66f88272a54/users/352176f40ecd408c92ebae8de5bcba04/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:52.456260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510c45-97de-4d3d-8838-3fed09137c2e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.457259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510c45-97de-4d3d-8838-3fed09137c2e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.457732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510c45-97de-4d3d-8838-3fed09137c2e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.460336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 125/235] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:52.466484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.467389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.467916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.477697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdf63d-a993-42aa-9a39-e1299e020932 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.478297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdf63d-a993-42aa-9a39-e1299e020932 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.478787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdf63d-a993-42aa-9a39-e1299e020932 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.480627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 126/236] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:52.489451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749157-be72-4497-9811-e167ddfc9608 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.489755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749157-be72-4497-9811-e167ddfc9608 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.490125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749157-be72-4497-9811-e167ddfc9608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.491989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:52.493511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:52.522156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-45749157-be72-4497-9811-e167ddfc9608 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:52.525260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-45749157-be72-4497-9811-e167ddfc9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:52.540407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:52.602575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 111/237] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:52.626155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:52.627197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 127/238] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:52.654472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749157-be72-4497-9811-e167ddfc9608 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:52.670100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:52.736431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7fbe-b5c0-4074-b8f0-74eabf710d1c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:52.765622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749157-be72-4497-9811-e167ddfc9608 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:52.773652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:52.774739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.775250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.775696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.798034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:52.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:52.811659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:52.812501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 112/239] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:52.824680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:52.824853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:52.825964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:52.826423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:52.826874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:52.828270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:52.830306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:52.833709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 128/240] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:52.844904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:52.869393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:52.997290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cce08-bdb8-4267-a1d7-f22af9805852 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.032406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:53.049762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d8cc-b0ba-46bc-ad64-8abe064bd867 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.063264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.063965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.064257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.064538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.065306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:53.065617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:53.067013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:53.082317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 113/241] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:53.089950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.121118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f624-0750-4c39-aa6f-4177b0635917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.122196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f624-0750-4c39-aa6f-4177b0635917 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.122678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f624-0750-4c39-aa6f-4177b0635917 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.123153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f624-0750-4c39-aa6f-4177b0635917 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.124100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94f624-0750-4c39-aa6f-4177b0635917 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:53.125761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94f624-0750-4c39-aa6f-4177b0635917 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:53.176454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 129/242] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:52 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:53.187494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:53.205933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131dc92-0243-4175-9a68-fa2bd940999f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.219974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898358f3-4f9a-4e49-bd3f-ca7129744979 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.220295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898358f3-4f9a-4e49-bd3f-ca7129744979 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.220553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898358f3-4f9a-4e49-bd3f-ca7129744979 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.222057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 130/243] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:53.228313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.228619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.228889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.261671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.262587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.262942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.263231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] PATH_INFO: `/v3/users/466998db060144c2ba44ce3131e2d11d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.264991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:53.266224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:53.298897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] RBAC: Authorizing `identity:get_user(user_id=466998db060144c2ba44ce3131e2d11d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:53.300755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:53.303790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 114/244] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/users/466998db060144c2ba44ce3131e2d11d => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:53.311411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.413141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 131/245] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:53.436385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.440099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a7e0-7ed3-454b-a978-682e6ca3a018 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.489742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.490382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.490952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.490952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.509571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:53.526659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:53.569180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7681bc-196f-4f1d-b876-e9f311d7e1d9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.571752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:53.573883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:53.609850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.611013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.611505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.612020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.624698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:53.634044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:53.634999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:53.635930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:53.641363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 132/246] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:53.646676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.688001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 115/247] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:53.689465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.733591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:53.777441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e2f6-6146-413a-bdaa-e07de5e3746e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.793026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee514e-170b-4836-bc9c-239e3e39887f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.807440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:53.819802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.820817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.821309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.821792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.822909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:53.823497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:53.825250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:53.830692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:53.831738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:53.831873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:53.832141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:53.834978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:53.836573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:53.838460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 116/249] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:53.838750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 133/249] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:53.843504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.844897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:53.975508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648106-c726-4a44-a910-f98e0f7df268 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.980846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c804-951c-4acd-8889-76437ee7ed11 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:53.987577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:54.012230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:54.013108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.013442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.013653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] PATH_INFO: `/v3/users/9709aa875fea4522b569fa2895d30f7e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.014863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] RBAC: Authorizing `identity:get_user(user_id=9709aa875fea4522b569fa2895d30f7e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:54.016366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:54.018005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 117/250] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/users/9709aa875fea4522b569fa2895d30f7e => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:54.028829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:54.042561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:54.043230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.043511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.043785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.044661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] RBAC: Adding query filter params (role.id=9c05b0960e064efd8ac51a8cc9c26ad2, scope.project.id=88182820589348c0b422c66f88272a54, user.id=466998db060144c2ba44ce3131e2d11d) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:54.044974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:54.046434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:54.061902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 134/251] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:53 2022] GET /identity/v3/role_assignments?user.id=466998db060144c2ba44ce3131e2d11d&scope.project.id=88182820589348c0b422c66f88272a54&role.id=9c05b0960e064efd8ac51a8cc9c26ad2 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:54.191190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c873-e16b-4b97-96b7-df61f38b5b58 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:54.242140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798069cf-4b57-453a-8fb1-84c31d9e3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:54.243043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798069cf-4b57-453a-8fb1-84c31d9e3854 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.243335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798069cf-4b57-453a-8fb1-84c31d9e3854 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.243619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798069cf-4b57-453a-8fb1-84c31d9e3854 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.244981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798069cf-4b57-453a-8fb1-84c31d9e3854 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:54.246466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798069cf-4b57-453a-8fb1-84c31d9e3854 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:54.248261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 118/252] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:54 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:54.254465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:54.358586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:54.414617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95657a-d18d-40d8-bb2e-ee97ccbf8152 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:54.459621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca4d0-b7dd-427e-b7cd-34f3ead75cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:54.460471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca4d0-b7dd-427e-b7cd-34f3ead75cee None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.460760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca4d0-b7dd-427e-b7cd-34f3ead75cee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.461037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca4d0-b7dd-427e-b7cd-34f3ead75cee None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54/users/9709aa875fea4522b569fa2895d30f7e/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.469257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca4d0-b7dd-427e-b7cd-34f3ead75cee None admin] RBAC: Authorizing `identity:create_grant(project_id=88182820589348c0b422c66f88272a54, user_id=9709aa875fea4522b569fa2895d30f7e, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:54.470753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca4d0-b7dd-427e-b7cd-34f3ead75cee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:54.499652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 135/253] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:54 2022] PUT /identity/v3/projects/88182820589348c0b422c66f88272a54/users/9709aa875fea4522b569fa2895d30f7e/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:54.943228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30117-5a3e-490b-9015-48cd3d7eab7b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.943724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30117-5a3e-490b-9015-48cd3d7eab7b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.943821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30117-5a3e-490b-9015-48cd3d7eab7b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.945414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 119/254] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:54.961954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.962493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.962571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.990800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:54.992241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:54.996539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d465-f1b8-4641-945a-3123bc43642d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:54.996832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d465-f1b8-4641-945a-3123bc43642d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:54.997116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d465-f1b8-4641-945a-3123bc43642d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:54.999280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 120/255] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:55.010204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:55.011009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:55.012364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:55.049309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:55.051261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:55.126516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:55.166500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 136/256] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:55.179712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 121/257] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:55.198031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:55.212454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:55.293913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:55.408094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e3cbe-dcc6-4eea-bc2e-c4c5f5bb9114 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:55.452653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfa885-71c8-448b-aad7-e7c397aaa178 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:55.475532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:55.476744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:55.477239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:55.477719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:55.511226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:55.519528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:55.520450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:24:55.521471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:55.529358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 122/258] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:24:55.534887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:55.548540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:55.549365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:55.549661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:55.549944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:55.576718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:55.585519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:55.586442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:55.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 137/259] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:55.597885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:55.607098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:55.750930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320a67e-197d-44dc-9fc8-0d9c31a3d53e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:55.818984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:55.819664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:55.819995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:55.820260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:55.821314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:55.821629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:55.823113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:55.832031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 123/260] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:55.838180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:55.894056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720add0f-6bd0-404b-84ce-c01da5537ee1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:55.901635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:55.969780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:55.971262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:55.971754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:55.972275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:55.973397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:55.973917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:55.975535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:55.991960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 138/261] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:24:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:55.998128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:56.055122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:56.063771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648e0dd-20e1-4682-a2ac-af120bf2d413 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:56.157098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:56.157988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.158275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.158557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] PATH_INFO: `/v3/users/352176f40ecd408c92ebae8de5bcba04` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.164567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] RBAC: Authorizing `identity:get_user(user_id=352176f40ecd408c92ebae8de5bcba04)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:56.166035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:56.167708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 124/262] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:55 2022] GET /identity/v3/users/352176f40ecd408c92ebae8de5bcba04 => generated 283 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:56.173099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:56.187483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a011b8-f7d3-49ea-aba4-6f9c7e5362d7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:56.252663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:56.253932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.254421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.255632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] PATH_INFO: `/v3/users/352176f40ecd408c92ebae8de5bcba04` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.260594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] RBAC: Authorizing `identity:get_user(user_id=352176f40ecd408c92ebae8de5bcba04)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:56.262411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:56.264346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 139/263] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:55 2022] GET /identity/v3/users/352176f40ecd408c92ebae8de5bcba04 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:56.270077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:56.331173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:56.381901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1971-571f-4ff0-bfa2-1bec69a37e84 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:56.440562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020ba3f-3556-453f-9c4b-60cd49e52db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:56.441216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020ba3f-3556-453f-9c4b-60cd49e52db7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.441500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020ba3f-3556-453f-9c4b-60cd49e52db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.441776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020ba3f-3556-453f-9c4b-60cd49e52db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.450893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44dc5-e37c-4c58-99b7-51fae67a1d04 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:56.514948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:56.519609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:56.519730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.519730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.519730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.589533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020ba3f-3556-453f-9c4b-60cd49e52db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:56.591456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020ba3f-3556-453f-9c4b-60cd49e52db7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:56.605400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:56.606897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:56.641974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:56.713528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 140/264] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:24:56.721524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:56.791544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 125/265] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:56.793700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9734d-c994-4009-8d6f-0bdd6c57c01c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.794147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9734d-c994-4009-8d6f-0bdd6c57c01c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.794788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9734d-c994-4009-8d6f-0bdd6c57c01c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.806281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 126/266] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:56.806281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9734d-c994-4009-8d6f-0bdd6c57c01c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:56.835356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bcef-2d24-473d-b4ca-3b269988bdb3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:56.875631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c1cbd-3920-4d9c-a2e6-90abe792b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:56.876857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1cbd-3920-4d9c-a2e6-90abe792b74b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.877337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1cbd-3920-4d9c-a2e6-90abe792b74b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.878206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1cbd-3920-4d9c-a2e6-90abe792b74b None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.880165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c1cbd-3920-4d9c-a2e6-90abe792b74b None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:56.882246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c1cbd-3920-4d9c-a2e6-90abe792b74b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:56.885013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 141/267] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:56 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:24:56.886617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:56.887102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:56.887637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:56.893405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:56.915265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:56.916492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:56.927387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:56.999668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 142/268] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:57.000552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.008466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9734d-c994-4009-8d6f-0bdd6c57c01c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.064801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.066503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.067012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.068223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.069692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:57.071406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:57.073420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 127/269] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:56 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:57.074501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.175163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d4444-d1b7-4c9a-b7c1-5b931b78cced None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.181718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1b776-2bac-4f87-a9b2-6190663445ac None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.208948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:57.214446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.215099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.215390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.215656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.216523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] RBAC: Adding query filter params (role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=88182820589348c0b422c66f88272a54, user.id=352176f40ecd408c92ebae8de5bcba04) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:57.216831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:57.218294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:57.219358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e503fe-cf57-4738-903d-26fe0a5f8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.220349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e503fe-cf57-4738-903d-26fe0a5f8c41 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.220643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e503fe-cf57-4738-903d-26fe0a5f8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.220916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e503fe-cf57-4738-903d-26fe0a5f8c41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.222557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e503fe-cf57-4738-903d-26fe0a5f8c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:57.224077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e503fe-cf57-4738-903d-26fe0a5f8c41 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:57.230819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 143/270] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:56 2022] GET /identity/v3/role_assignments?user.id=352176f40ecd408c92ebae8de5bcba04&scope.project.id=88182820589348c0b422c66f88272a54&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:57.230819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.231096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 128/271] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:57.231096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052bc2e-7411-49b5-a095-6efe682dac73 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.231096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052bc2e-7411-49b5-a095-6efe682dac73 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.231096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052bc2e-7411-49b5-a095-6efe682dac73 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.231096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 129/272] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:57.231096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3893d9-43ff-43a4-b107-b549e0fe7acb None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.231435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3893d9-43ff-43a4-b107-b549e0fe7acb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.231500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3893d9-43ff-43a4-b107-b549e0fe7acb None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.233198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 130/273] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:24:57.234275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3893d9-43ff-43a4-b107-b549e0fe7acb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.240193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:57.371122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3893d9-43ff-43a4-b107-b549e0fe7acb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.386861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4853328-7b77-46fa-8228-2bc0b9810b0a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.420124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c626a2-8d5e-4242-a96a-ad2e5c2ad6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.420907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c626a2-8d5e-4242-a96a-ad2e5c2ad6fd None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.421189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c626a2-8d5e-4242-a96a-ad2e5c2ad6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.421464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c626a2-8d5e-4242-a96a-ad2e5c2ad6fd None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.422178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c626a2-8d5e-4242-a96a-ad2e5c2ad6fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:57.423637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c626a2-8d5e-4242-a96a-ad2e5c2ad6fd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:57.427140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.427789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.428135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.428418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.429267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=88182820589348c0b422c66f88272a54, user.id=352176f40ecd408c92ebae8de5bcba04) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:57.429589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:57.431068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021836e-7d47-42f3-be31-7da7ed2ca961 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:57.438840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 144/274] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:57 2022] GET /identity/v3/role_assignments?user.id=352176f40ecd408c92ebae8de5bcba04&scope.project.id=88182820589348c0b422c66f88272a54&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:57.439956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b06f-b345-458b-b2e2-5475115f9b52 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.440261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b06f-b345-458b-b2e2-5475115f9b52 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.440561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b06f-b345-458b-b2e2-5475115f9b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.463173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 131/275] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:24:57 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:24:57.463715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7c5b06f-b345-458b-b2e2-5475115f9b52 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:57.464475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.464767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.464965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7c5b06f-b345-458b-b2e2-5475115f9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:57.465091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.515502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:57.516767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:57.547956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:57.564479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 145/276] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:57.591504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb5407-8319-453b-830f-0722b3e1554d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.592083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb5407-8319-453b-830f-0722b3e1554d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.592512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb5407-8319-453b-830f-0722b3e1554d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.595706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 146/277] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:24:57.601001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.601521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.601974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.621430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:57.624323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:24:57.625863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:24:57.646121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 132/278] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:24:57.647059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.730849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 147/279] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:24:57.731630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.791587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb715-c1c4-4e48-b41b-11ddf2d082f4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.833694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.834593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.834939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.835282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.850376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:57.860336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:57.861350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:24:57.862249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:57.862895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f248-24a3-4834-9c42-b0ef9e8d8938 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:57.862979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 133/280] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:57.862979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.886377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:57.906143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:57.907243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:57.907534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:57.907812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:57.921679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:57.929895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:57.930783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:24:57.931568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 148/281] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:57.932696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:57.937316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:57.982999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c141-94d9-442f-871c-94bfec911084 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.018266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.019062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.019343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.019616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.030645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:24:58.038721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:24:58.039609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:24:58.040461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 134/282] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:24:58.041120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.047667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b73f66-c51b-494b-81a2-b68dd3bcc0de None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.084870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.086028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.086510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.086978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.088092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:58.088598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.090339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.100019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 149/283] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.101150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.149214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:58.158845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb91b-2f6e-4824-b11b-593f57f98846 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.170819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:58.196462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.197150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.197559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.197693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.198435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:58.198745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.200175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.209585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 135/284] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.210551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.217771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f33b-46ae-4cb3-8f36-25c460f3bfd1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.262768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.263772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.264304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.265185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.266421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:58.267060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.268993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.282258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 150/285] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.282913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.337725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ef8f-d542-4f32-b77c-009d8a0f262b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.378900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.380449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.380796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.381138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] PATH_INFO: `/v3/users/466998db060144c2ba44ce3131e2d11d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.382411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] RBAC: Authorizing `identity:get_user(user_id=466998db060144c2ba44ce3131e2d11d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.384257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.390533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 136/286] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/users/466998db060144c2ba44ce3131e2d11d => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.391498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.404504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893eee74-d037-4e82-a93f-0cdcf458b5eb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.408037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:58.445476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.446425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.446732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.447003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] PATH_INFO: `/v3/users/ac6b312c9122451e8e2b384d2f91aa72` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.449675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:58.462706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] RBAC: Authorizing `identity:get_user(user_id=ac6b312c9122451e8e2b384d2f91aa72)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.464383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.466444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 151/287] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/users/ac6b312c9122451e8e2b384d2f91aa72 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.467041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.530921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0cf26-9e31-44f5-9354-2ec3e3f704a7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.576527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269688-4f1f-4345-b9e6-1946288acffa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.577108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.578439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.579769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.580277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] PATH_INFO: `/v3/users/9709aa875fea4522b569fa2895d30f7e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.581673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] RBAC: Authorizing `identity:get_user(user_id=9709aa875fea4522b569fa2895d30f7e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.583424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.586530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 137/288] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/users/9709aa875fea4522b569fa2895d30f7e => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.588004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.613994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.614901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.615188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.615866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.616802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.618246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.620465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 152/289] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.625598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.658852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:58.723477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a0db7-5cc5-4e12-81b8-28e788977a59 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.732913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:58.742992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322103b-6a2d-47c7-ba7c-4fa9d9f51115 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.765629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.766266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.766549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.766822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.767781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, user.id=ac6b312c9122451e8e2b384d2f91aa72, scope.system=all) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:58.768349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.769609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.775495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 138/290] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/role_assignments?user.id=ac6b312c9122451e8e2b384d2f91aa72&scope.system=all&role.id=fde1ffae211846158ce1303a9da8610d => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:58.776535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:58.801183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:58.804650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:58.804650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:58.804890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:58.911113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:58.912596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:58.972509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6beb-6835-4dc6-8860-39a6cebc1470 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:58.976753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:59.009571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:59.010416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:59.010699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:59.010975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54/users/466998db060144c2ba44ce3131e2d11d/roles/9c05b0960e064efd8ac51a8cc9c26ad2` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:59.013069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=88182820589348c0b422c66f88272a54, user_id=466998db060144c2ba44ce3131e2d11d, role_id=9c05b0960e064efd8ac51a8cc9c26ad2)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:59.014784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:59.030550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 139/291] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:24:58 2022] PUT /identity/v3/projects/88182820589348c0b422c66f88272a54/users/466998db060144c2ba44ce3131e2d11d/roles/9c05b0960e064efd8ac51a8cc9c26ad2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:24:59.069912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 153/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:24:59.075573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:59.122797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:59.202148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab8b0-ca2f-4390-8ff2-32ae02e405f5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:59.240144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebe3da-4064-44bb-9778-6bd669263dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:59.241078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe3da-4064-44bb-9778-6bd669263dab None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:59.241370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe3da-4064-44bb-9778-6bd669263dab None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:59.241815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe3da-4064-44bb-9778-6bd669263dab None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:59.243301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebe3da-4064-44bb-9778-6bd669263dab None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:59.244813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebe3da-4064-44bb-9778-6bd669263dab None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:59.246870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 140/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:24:59 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:24:59.252621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:24:59.365430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcdba5-25ce-4c53-8b53-bf48c7eb74ca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:24:59.394886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:24:59.405245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:24:59.405994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:24:59.406692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:24:59.406976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:24:59.407825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=88182820589348c0b422c66f88272a54, user.id=9709aa875fea4522b569fa2895d30f7e) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:24:59.408175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:24:59.409931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639842bf-9aaa-4935-95be-8a9b70bf45cf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:24:59.420632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 154/294] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:24:59 2022] GET /identity/v3/role_assignments?user.id=9709aa875fea4522b569fa2895d30f7e&scope.project.id=88182820589348c0b422c66f88272a54&role.id=fde1ffae211846158ce1303a9da8610d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:00.048789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b516e-ec9c-4be5-b759-8712285776c5 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.049490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b516e-ec9c-4be5-b759-8712285776c5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.049980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b516e-ec9c-4be5-b759-8712285776c5 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.051942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 141/295] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:00.058480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.058729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.059005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.060505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf75-a718-49ca-bf46-745b6fd87b0d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.061110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf75-a718-49ca-bf46-745b6fd87b0d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.061679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf75-a718-49ca-bf46-745b6fd87b0d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.063572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 142/296] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:00.068945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.069467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.069945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.078639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:00.079863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:00.088270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:00.089734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:00.156590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 155/297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:00.163964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 143/298] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:00.179921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:00.186190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:00.220116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:00.280095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b115-ab40-4d21-ba70-3b1fc8fae653 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:00.294196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252249d-6006-4061-941a-0cfc8b5353fa None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:00.304139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:00.314955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:00.316308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.316804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.317575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.328435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:00.334218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:00.335211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.335639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:00.337649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:00.338642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:00.339450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:00.340738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.343913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 156/299] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:00.344780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:00.346233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:00.347986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 144/300] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:00.349251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:00.354546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:00.453551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:00.460406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e12f0-c172-4b23-a233-8f206997e132 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:00.467044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c3366-77c1-4778-b533-4888509a34c9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:00.497753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:00.498513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.498805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.499084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.499973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:00.500287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:00.501668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:00.505447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:00.506352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.506856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.507377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] PATH_INFO: `/v3/groups` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.508549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:00.510194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:00.510805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 145/301] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:00.516248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:00.529774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 157/302] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jun 22 18:25:00 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:00.642396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eb8ee-8803-47fc-ae64-b7a7b81d11be None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:00.682038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3e06c-845f-48d5-ae6b-332b86e26cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:00.683483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e06c-845f-48d5-ae6b-332b86e26cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.683998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e06c-845f-48d5-ae6b-332b86e26cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.684285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e06c-845f-48d5-ae6b-332b86e26cf7 None admin] PATH_INFO: `/v3/users/c8e26caf04fa4bafa1b2afffd5ce52e1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.699388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3e06c-845f-48d5-ae6b-332b86e26cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e26caf04fa4bafa1b2afffd5ce52e1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:00.700875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3e06c-845f-48d5-ae6b-332b86e26cf7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:00.702591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 146/303] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:25:00 2022] GET /identity/v3/users/c8e26caf04fa4bafa1b2afffd5ce52e1 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:00.708823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:00.762576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:00.820213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaaaa3-0b32-4866-a693-f5fe54bc05df None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:00.858447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:00.859495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:00.860055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:00.860538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:00.861591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] RBAC: Adding query filter params (role.id=9c05b0960e064efd8ac51a8cc9c26ad2, user.id=c8e26caf04fa4bafa1b2afffd5ce52e1, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:00.862101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:00.863735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91956494-dd70-4b45-943a-0e23abc7c6cf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:00.869338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 158/304] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 18:25:00 2022] GET /identity/v3/role_assignments?user.id=c8e26caf04fa4bafa1b2afffd5ce52e1&scope.system=all&role.id=9c05b0960e064efd8ac51a8cc9c26ad2 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:01.008580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657e5b-14cc-459c-bb1f-f2a736179485 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.009103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657e5b-14cc-459c-bb1f-f2a736179485 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.009616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657e5b-14cc-459c-bb1f-f2a736179485 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.011997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 147/305] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:01.018247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.018550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.018827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.036550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:01.037758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:01.110212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 159/306] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:01.136194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657e5b-14cc-459c-bb1f-f2a736179485 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:01.155628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:01.242965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657e5b-14cc-459c-bb1f-f2a736179485 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:01.278839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2ab87-c755-416a-b5ac-52a4f5dd534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:01.279594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2ab87-c755-416a-b5ac-52a4f5dd534d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.279864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2ab87-c755-416a-b5ac-52a4f5dd534d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.280141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2ab87-c755-416a-b5ac-52a4f5dd534d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.290810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2ab87-c755-416a-b5ac-52a4f5dd534d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3ea2ab87-c755-416a-b5ac-52a4f5dd534d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:01.298537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:01.299407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:01.300217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 148/307] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:01.306326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:01.356481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:01.422468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4005f50-cbbb-4184-85a6-b0a057b5fae1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:01.458930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106fd5a-7ccb-446d-96ba-0aeb2f144fea None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.459328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106fd5a-7ccb-446d-96ba-0aeb2f144fea None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.459615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106fd5a-7ccb-446d-96ba-0aeb2f144fea None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.460249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:01.460923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.461210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.461492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.462252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:01.462431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 149/308] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:01.462588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:01.463971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:01.466314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.466604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.466888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.476995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 160/309] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:01.482012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:01.484962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:01.486506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:01.564116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 150/310] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:01.585590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:01.594930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:01.609120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:01.612592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970c560-5663-438f-967f-459bb1a7c7df None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:01.658268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:01.659488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.659865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.661109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] PATH_INFO: `/v3/users/ac6b312c9122451e8e2b384d2f91aa72` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.662622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] RBAC: Authorizing `identity:get_user(user_id=ac6b312c9122451e8e2b384d2f91aa72)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:01.664166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:01.667069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 161/311] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:25:01 2022] GET /identity/v3/users/ac6b312c9122451e8e2b384d2f91aa72 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:01.673220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:01.706182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241208-97e4-45e9-8656-f99d7e74dc4c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:01.757027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:01.757876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.758411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.758686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.776624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:01.784585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:01.785765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:01.786628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:01.792212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 151/312] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:01.793119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:01.808378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b47bc-c878-4b80-b792-cea27613cd13 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:01.856338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:01.857752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.858646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.859348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] PATH_INFO: `/v3/system/users/ac6b312c9122451e8e2b384d2f91aa72/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.861071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac6b312c9122451e8e2b384d2f91aa72, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:01.861793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:01.865863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:01.878134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 162/313] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jun 22 18:25:01 2022] PUT /identity/v3/system/users/ac6b312c9122451e8e2b384d2f91aa72/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:01.914639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b5f5-1e81-4c2b-b1e6-e9f1216ce5a0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:01.954845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:01.955529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:01.955813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:01.956341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:01.957181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:01.958112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:01.959529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:01.969283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 152/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:01.975884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:02.018843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:02.090240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bacc2-9375-4505-a0ff-9980e7b19f7f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:02.125891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:02.126733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.127025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.127305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] PATH_INFO: `/v3/users/466998db060144c2ba44ce3131e2d11d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.128549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] RBAC: Authorizing `identity:get_user(user_id=466998db060144c2ba44ce3131e2d11d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:02.130707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:02.132688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 163/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:25:01 2022] GET /identity/v3/users/466998db060144c2ba44ce3131e2d11d => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:02.138117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:02.243986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6c0c-d7dd-47fe-9b07-591048fedf25 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:02.271634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:02.280474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:02.281124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.281420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.281680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.354840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:02.356345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:02.464169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 153/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:02.465513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:02.567497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:02.571024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c0e15-0fab-4f47-861b-2b172febb08f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:02.606398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128657c-87cd-4099-8f03-6adfb44a4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:02.607337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128657c-87cd-4099-8f03-6adfb44a4964 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.607624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128657c-87cd-4099-8f03-6adfb44a4964 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.607939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128657c-87cd-4099-8f03-6adfb44a4964 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.609140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128657c-87cd-4099-8f03-6adfb44a4964 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:02.610609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128657c-87cd-4099-8f03-6adfb44a4964 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:02.612675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 164/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:02 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:02.619215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:02.649123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:02.734030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1465d-1147-4595-a7e1-128d65c3841d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:02.763937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f3fb4-059c-4441-974d-98b27f642966 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.763937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f3fb4-059c-4441-974d-98b27f642966 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.763937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f3fb4-059c-4441-974d-98b27f642966 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.765411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 165/318] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:02.771740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8deb4d-7f8e-4fad-8792-e1e2b9161a9c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.772281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8deb4d-7f8e-4fad-8792-e1e2b9161a9c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.772760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8deb4d-7f8e-4fad-8792-e1e2b9161a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.774411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:02.775176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.775460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.775737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.776720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] RBAC: Adding query filter params (role.id=9c05b0960e064efd8ac51a8cc9c26ad2, scope.project.id=88182820589348c0b422c66f88272a54, user.id=466998db060144c2ba44ce3131e2d11d) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:02.777035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:02.778580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:02.786827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 154/319] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:02 2022] GET /identity/v3/role_assignments?user.id=466998db060144c2ba44ce3131e2d11d&scope.project.id=88182820589348c0b422c66f88272a54&role.id=9c05b0960e064efd8ac51a8cc9c26ad2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:02.796442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6b8deb4d-7f8e-4fad-8792-e1e2b9161a9c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:02.798057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6b8deb4d-7f8e-4fad-8792-e1e2b9161a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:02.885681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 166/320] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:02.909724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:02.981964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b0372-09d6-483c-9b30-ec7568d9dc08 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.982256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b0372-09d6-483c-9b30-ec7568d9dc08 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.982539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b0372-09d6-483c-9b30-ec7568d9dc08 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:02.983973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 167/321] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:02.990845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:02.991412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:02.991697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.012911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:03.014541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:03.018027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:03.031141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964b777-7c81-4ad3-b234-c34f0bebac0e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:03.069366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:03.070193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:03.070483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:03.070763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.072093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:03.073604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:03.075519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 155/322] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:03.080675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:03.099300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 168/323] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:03.121164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:03.150113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:03.187206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476e4dc-53ee-4056-b8b1-9dd3048c43c4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:03.222105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:03.222768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:03.223080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:03.223360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] PATH_INFO: `/v3/groups` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.223527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815da9f3-6f7b-4f8a-b7e6-255bfc24d83b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:03.224087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:03.225532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:03.242005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 156/324] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jun 22 18:25:03 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:25:03.264407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:03.265668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:03.266168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:03.266796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.279780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:03.288767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:03.289780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:03.290588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:03.292000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 169/325] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:03.297721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:03.323262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:03.417513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853b36-4ec3-4a61-b19f-f518e043cf95 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:03.453894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:03.454854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:03.455435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:03.455725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.456514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:03.456826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:03.458349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:03.466635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 157/326] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:03.472523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:03.573625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:03.588898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195b623-2074-4eea-b1e5-1acf7d00d0c6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:03.626789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87ccff-0791-495a-a401-217933fcf075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:03.627730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87ccff-0791-495a-a401-217933fcf075 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:03.628046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87ccff-0791-495a-a401-217933fcf075 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:03.628326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87ccff-0791-495a-a401-217933fcf075 None admin] PATH_INFO: `/v3/users/c8e26caf04fa4bafa1b2afffd5ce52e1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.630177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87ccff-0791-495a-a401-217933fcf075 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e26caf04fa4bafa1b2afffd5ce52e1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:03.631662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87ccff-0791-495a-a401-217933fcf075 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:03.633992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 170/327] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:25:03 2022] GET /identity/v3/users/c8e26caf04fa4bafa1b2afffd5ce52e1 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:03.639511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:03.734263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:03.754754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc86420-2113-4a93-a0b3-fc839455d2b4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:03.792387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326ac03-0ead-4077-b351-d7c80456c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:03.793265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ac03-0ead-4077-b351-d7c80456c4c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:03.793551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ac03-0ead-4077-b351-d7c80456c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:03.793829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ac03-0ead-4077-b351-d7c80456c4c2 None admin] PATH_INFO: `/v3/system/users/c8e26caf04fa4bafa1b2afffd5ce52e1/roles/9c05b0960e064efd8ac51a8cc9c26ad2` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:03.795377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326ac03-0ead-4077-b351-d7c80456c4c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8e26caf04fa4bafa1b2afffd5ce52e1, role_id=9c05b0960e064efd8ac51a8cc9c26ad2)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:03.796819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326ac03-0ead-4077-b351-d7c80456c4c2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:03.808526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 158/328] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jun 22 18:25:03 2022] PUT /identity/v3/system/users/c8e26caf04fa4bafa1b2afffd5ce52e1/roles/9c05b0960e064efd8ac51a8cc9c26ad2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:25:04.062872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079339-98af-4776-b6cd-25797bb8dd8a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:04.063259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079339-98af-4776-b6cd-25797bb8dd8a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:04.063457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079339-98af-4776-b6cd-25797bb8dd8a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:04.065172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 171/329] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:04.070761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:04.071053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:04.071328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:04.092790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:04.094003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:04.176935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 159/330] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:04.205327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079339-98af-4776-b6cd-25797bb8dd8a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:04.321144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079339-98af-4776-b6cd-25797bb8dd8a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:04.358530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:04.359696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:04.360208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:04.360700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:04.371861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:04.380578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:04.381455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:04.382226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:04.389548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 172/331] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:04.391159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:04.477729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:04.509162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255ff4f-dbb7-4992-86e9-1538e86320c6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:04.547534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:04.548597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:04.549102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:04.549573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:04.550517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:04.551020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:04.552759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:04.563566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 160/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:04.570296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:04.592411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:04.685037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419e523-75f6-49e2-be68-f0edac30fdf7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:04.724499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841f0e7-9721-4430-87d6-a5f0c9bb2a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:04.725780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f0e7-9721-4430-87d6-a5f0c9bb2a67 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:04.726295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f0e7-9721-4430-87d6-a5f0c9bb2a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:04.726765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f0e7-9721-4430-87d6-a5f0c9bb2a67 None admin] PATH_INFO: `/v3/users/ac6b312c9122451e8e2b384d2f91aa72` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:04.728227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f0e7-9721-4430-87d6-a5f0c9bb2a67 None admin] RBAC: Authorizing `identity:get_user(user_id=ac6b312c9122451e8e2b384d2f91aa72)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:04.729879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f0e7-9721-4430-87d6-a5f0c9bb2a67 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:04.735931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 173/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:25:04 2022] GET /identity/v3/users/ac6b312c9122451e8e2b384d2f91aa72 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:04.738064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:04.855017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753de772-9a32-405b-afa1-ce674fffbe60 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:04.898594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:04.899266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:04.899549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:04.899827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:04.900714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] RBAC: Adding query filter params (role.id=fde1ffae211846158ce1303a9da8610d, user.id=ac6b312c9122451e8e2b384d2f91aa72, scope.system=all) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:04.901027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:04.902464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddb0b9-1e5f-4513-8c37-7dd254dc806c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:04.908707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:04.917926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 161/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 18:25:04 2022] GET /identity/v3/role_assignments?user.id=ac6b312c9122451e8e2b384d2f91aa72&scope.system=all&role.id=fde1ffae211846158ce1303a9da8610d => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:05.917957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d5c8-960b-4347-bd7e-b52f140061b4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:05.918457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d5c8-960b-4347-bd7e-b52f140061b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:05.918563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d5c8-960b-4347-bd7e-b52f140061b4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:05.920046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 174/335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:05.925461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:05.925868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:05.926011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:05.951575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:05.953052 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:06.025283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dcf0-af21-418d-b68c-8ca5bfa099b1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.025903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dcf0-af21-418d-b68c-8ca5bfa099b1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.026386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dcf0-af21-418d-b68c-8ca5bfa099b1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:06.028263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 175/336] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:06.033050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.033582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.034065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:06.034316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 162/337] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:06.064889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:06.066465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:06.122116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:06.174529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 176/338] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:06.217500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:06.245134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:06.281690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ede1-cb3b-4de7-9df0-cd0422c2c6da None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:06.323043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:06.335371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:06.336441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.336886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.337499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:06.350619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:06.362858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:06.364497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:06.365301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:06.368005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 163/339] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:06.378250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:06.427083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96730-f6ae-4f27-abe6-31a08e41867b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:06.479486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:06.480556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.483606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.484049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:06.509061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:06.521670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:06.522742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:06.523694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:06.533484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 177/340] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:06.540679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:06.596539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b045-3c90-4caa-81e0-fd919ac25d59 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:06.666826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:06.667736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.668184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.668606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:06.669524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:06.669971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:06.671478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:06.686958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 164/341] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:06.692746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:06.726446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:06.770506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed465d67-8197-41ca-a2d8-e576b4628a88 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:06.810299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:06.811443 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:06.812398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.812898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.813444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:06.814388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:06.814855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:06.816576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:06.827370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 178/342] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:06.835853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:06.880825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136752-0cad-4313-b2c0-05683be7f7ea None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:06.937114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:06.938437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:06.938890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:06.939293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.030953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5869-997b-4aa9-8fd5-22de913d5616 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:07.053050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:07.054787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:07.105423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087dbaa-8893-465c-9bbd-3020f735511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:07.106142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087dbaa-8893-465c-9bbd-3020f735511b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.106706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087dbaa-8893-465c-9bbd-3020f735511b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.106985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087dbaa-8893-465c-9bbd-3020f735511b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.116199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:07.138963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:07.233438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 165/343] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:07.239733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:07.284986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087dbaa-8893-465c-9bbd-3020f735511b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:07.286754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087dbaa-8893-465c-9bbd-3020f735511b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:07.389064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d290789-b5d4-4cf2-a706-987410fe2599 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:07.436012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ac25a-f45a-47d2-a330-8c354b03c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:07.437814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac25a-f45a-47d2-a330-8c354b03c7bc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.438354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac25a-f45a-47d2-a330-8c354b03c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.438774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac25a-f45a-47d2-a330-8c354b03c7bc None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.445860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ac25a-f45a-47d2-a330-8c354b03c7bc None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:07.447739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ac25a-f45a-47d2-a330-8c354b03c7bc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:07.450501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 166/344] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:07 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:07.454540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba866-ac15-47f2-b9b0-290c48de090a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.455180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba866-ac15-47f2-b9b0-290c48de090a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.455760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba866-ac15-47f2-b9b0-290c48de090a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.457894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 167/345] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:07.460146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba866-ac15-47f2-b9b0-290c48de090a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:07.482001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:07.536885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 179/346] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:25:07.538193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.538488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.538765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.572957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:07.574154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:07.589524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba866-ac15-47f2-b9b0-290c48de090a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:07.633397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:07.634384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.634935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.635220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.643326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:07.646236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:07.648252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:07.650734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 168/347] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:07 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:07.651719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:07.707105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 180/348] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:07.708039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:07.794283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:07.818510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dde98-1a2f-4b8b-87e7-e2f9fc0e20b8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:07.857240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd546f9c-2c71-43be-889b-c41a4377a410 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:07.862708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3f78-f3e3-4ff6-8e4e-fbb061e39fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:07.864182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3f78-f3e3-4ff6-8e4e-fbb061e39fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.864656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3f78-f3e3-4ff6-8e4e-fbb061e39fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.864935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3f78-f3e3-4ff6-8e4e-fbb061e39fb6 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.866172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3f78-f3e3-4ff6-8e4e-fbb061e39fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:07.868290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3f78-f3e3-4ff6-8e4e-fbb061e39fb6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:07.870338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 169/349] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:07 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:07.871332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf38e-c1f7-4b3e-82a6-0d35ae76f748 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.871628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf38e-c1f7-4b3e-82a6-0d35ae76f748 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.874888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf38e-c1f7-4b3e-82a6-0d35ae76f748 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.874888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 170/350] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:07.874888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdf38e-c1f7-4b3e-82a6-0d35ae76f748 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:07.912859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:07.913902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.914331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.915051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.916495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=62e18d972836416e8f3752123e2d3322) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:07.917053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:07.918529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3a557-c24b-4197-85bd-172cabb9283d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:07.924967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 181/351] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:07 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:07.926867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c749a1-2136-4e2d-9a62-6cf9a0142ca5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:07.927207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c749a1-2136-4e2d-9a62-6cf9a0142ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:07.927488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c749a1-2136-4e2d-9a62-6cf9a0142ca5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:07.928861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 182/352] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:07.933181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c749a1-2136-4e2d-9a62-6cf9a0142ca5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:07.971796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.033163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdf38e-c1f7-4b3e-82a6-0d35ae76f748 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.063821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c749a1-2136-4e2d-9a62-6cf9a0142ca5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.088637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063352d0-bab0-46b4-9a9e-01f6d09b886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.089453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063352d0-bab0-46b4-9a9e-01f6d09b886d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.089736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063352d0-bab0-46b4-9a9e-01f6d09b886d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.090010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063352d0-bab0-46b4-9a9e-01f6d09b886d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.106169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063352d0-bab0-46b4-9a9e-01f6d09b886d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:08.109348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da363a-ce22-4591-b52a-6e7ffea22662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.111206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da363a-ce22-4591-b52a-6e7ffea22662 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.111846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da363a-ce22-4591-b52a-6e7ffea22662 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.112203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da363a-ce22-4591-b52a-6e7ffea22662 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.113506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da363a-ce22-4591-b52a-6e7ffea22662 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-063352d0-bab0-46b4-9a9e-01f6d09b886d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:08.113985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:08.114877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 18:25:08.115700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:08.116353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da363a-ce22-4591-b52a-6e7ffea22662 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:08.116423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 171/353] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:08.117192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.117192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.117346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 183/354] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:07 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:08.117510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.122189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.122189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.122189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.138865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:08.139794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:08.140162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:08.140991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:08.142454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.224028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 172/355] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:08.224863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.239666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 184/356] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:08.240637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.282679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.363905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3ac1f-0678-4f1b-8488-7b9bbb1cfdcd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.377523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b719c2-8126-4f29-9aa4-401169a34196 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.415035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.415716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.416027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.416305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.417064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:08.417371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:08.418771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:08.425755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.429742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 173/357] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:08.430710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.433296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.434413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.434840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.436170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.437054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=62e18d972836416e8f3752123e2d3322) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:08.437387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:08.438925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:08.447326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 185/358] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=fde1ffae211846158ce1303a9da8610d => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:08.447877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.568736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44b1c-f236-47c6-a26e-2961d0a6f62f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.575197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.586170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966a9cf-7f6e-4279-ab7b-8387d94697ac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.605692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a1956-df93-4831-be07-dff74741e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.606514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1956-df93-4831-be07-dff74741e811 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.606800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1956-df93-4831-be07-dff74741e811 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.607082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1956-df93-4831-be07-dff74741e811 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.619678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a1956-df93-4831-be07-dff74741e811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:08.628273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f45a1956-df93-4831-be07-dff74741e811 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:08.628595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:08.630776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:08.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:08.634458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.634458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.634731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 174/359] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:08.634731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac1425-bfff-4da2-8896-555f8818fc7e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.634731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac1425-bfff-4da2-8896-555f8818fc7e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.634731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac1425-bfff-4da2-8896-555f8818fc7e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.634731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 175/360] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:08.634731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac1425-bfff-4da2-8896-555f8818fc7e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.635482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.655210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:08.663695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:08.664702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:08.665493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:08.667026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 186/361] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:08.667129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.714147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.773126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac1425-bfff-4da2-8896-555f8818fc7e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.814007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc64b4-625d-4e87-aa1b-660e3c397b74 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:08.817381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1e1a-f44e-49d1-9e80-1a5aab05b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.817923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1e1a-f44e-49d1-9e80-1a5aab05b368 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.818212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1e1a-f44e-49d1-9e80-1a5aab05b368 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.818495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1e1a-f44e-49d1-9e80-1a5aab05b368 None admin] PATH_INFO: `/v3/users/c8e26caf04fa4bafa1b2afffd5ce52e1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.819796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d1e1a-f44e-49d1-9e80-1a5aab05b368 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e26caf04fa4bafa1b2afffd5ce52e1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:08.821358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d1e1a-f44e-49d1-9e80-1a5aab05b368 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:08.827938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 176/362] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/users/c8e26caf04fa4bafa1b2afffd5ce52e1 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:08.829437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.829676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.830039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.851911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:08.853525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:08.858528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:08.859057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:08.859345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:08.859624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:08.860453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:08.861438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:08.862167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:08.873761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 187/363] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:08.874634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:08.895057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:08.963879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 177/364] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:08.963879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.026390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41d7f-d89c-4ccb-bc91-d53fc1f91aaf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.035169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.074955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.075545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.075854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.076157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.077373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:09.077830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:09.079629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:09.086464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116fab1-91d0-45b2-800a-df6afb9fbe81 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.091577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 188/365] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:09.095959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.147008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.147008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.147008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.147008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.147405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] RBAC: Adding query filter params (role.id=9c05b0960e064efd8ac51a8cc9c26ad2, user.id=c8e26caf04fa4bafa1b2afffd5ce52e1, scope.system=all) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:09.147405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:09.147405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:09.159542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 178/366] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 18:25:08 2022] GET /identity/v3/role_assignments?user.id=c8e26caf04fa4bafa1b2afffd5ce52e1&scope.system=all&role.id=9c05b0960e064efd8ac51a8cc9c26ad2 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:09.160927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.242427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.283596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170891-1ac0-4ee0-80fc-c0e0ceeb3d41 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.315901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e29840-2e1e-45a7-8533-f742d398387d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.351968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.360443 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.361116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.361404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.361682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.390503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.391703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.392203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.392625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.412016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:09.422679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:09.423622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:09.424490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:09.426951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 179/367] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:09.429209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.462767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:09.464635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:09.548960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a99c4d-a872-4150-874b-c7ba43ed593f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.558106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.586924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.587677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.589142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.589489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.589945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 189/368] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:09.590858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.652944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.668486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:09.670135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:09.702197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbcef6-491d-4be2-9ae7-17865be5540c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.742574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.743249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.743532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.743807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.744622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:09.744934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:09.746317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:09.756835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 190/369] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:09.757690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.802529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.804671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 180/370] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:09.806859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.874910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683b5b-5836-4dc4-bd9f-7430bc330b2b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:09.906462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:09.916944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:09.917797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:09.918077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:09.918348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:09.922659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:09.922659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:09.925098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 191/371] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:09.925098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:09.950157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988edb1-e139-4acc-9951-1674411ed605 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.002850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.003919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.004522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.005000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.055525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f841f04-6560-4daf-b190-0bbec8271fdb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.064970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:10.096637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.097123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.098081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.099447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.099983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.100455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.101906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.103546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.105504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 192/372] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.106647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.198293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:10.228927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 181/373] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:10.230144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.242298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76ec63-1cc4-42e7-bf26-98f40b7b0281 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.291160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.292427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.292718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.292997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.294206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.295660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.298525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 193/374] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.303653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.361247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:10.363825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212070d8-35eb-4769-9a0d-4bb7becffff3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.404337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.406049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.406349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.406635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.407920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.409407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.412213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 182/375] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.413013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.435508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6e0d-64f7-4b49-a892-9560673907e0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.474301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:10.475539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde12c0-b3e4-4e49-91c6-75eef8ad5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.476513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde12c0-b3e4-4e49-91c6-75eef8ad5438 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.477124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde12c0-b3e4-4e49-91c6-75eef8ad5438 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.477407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde12c0-b3e4-4e49-91c6-75eef8ad5438 None admin] PATH_INFO: `/v3/projects/5555f070d6fd48a3923494f663482206` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.478689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde12c0-b3e4-4e49-91c6-75eef8ad5438 None admin] RBAC: Authorizing `identity:get_project(project_id=5555f070d6fd48a3923494f663482206)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.480166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde12c0-b3e4-4e49-91c6-75eef8ad5438 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.482032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 194/376] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/projects/5555f070d6fd48a3923494f663482206 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.484306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822093fa-6447-4236-a9dc-b890aab7d3f4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.484306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822093fa-6447-4236-a9dc-b890aab7d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.484306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822093fa-6447-4236-a9dc-b890aab7d3f4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.485278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 195/377] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:10.486044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822093fa-6447-4236-a9dc-b890aab7d3f4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.542770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3654c3e-41be-4a05-9922-a80cede8841b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.591502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.592955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.593521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.594067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.598900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=88182820589348c0b422c66f88272a54) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:10.598900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.599459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.608653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 183/378] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=88182820589348c0b422c66f88272a54&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.610176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.644510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822093fa-6447-4236-a9dc-b890aab7d3f4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.664289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:10.695703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.696674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.697078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.697367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.698307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=88182820589348c0b422c66f88272a54) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:10.698912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.700698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603533d-80f2-4ebd-a19f-44a8a2e9c3dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.710586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 196/379] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=88182820589348c0b422c66f88272a54&role.id=fde1ffae211846158ce1303a9da8610d => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.712998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa582-621a-484d-96c5-44393b86bef8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.713531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa582-621a-484d-96c5-44393b86bef8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.714017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa582-621a-484d-96c5-44393b86bef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.751644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e43aa582-621a-484d-96c5-44393b86bef8 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:10.752460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e43aa582-621a-484d-96c5-44393b86bef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:10.808731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ca12e-bdbf-4129-8b73-bb6468c3368c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:10.821414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:10.860682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:10.861563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.861846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.862120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] PATH_INFO: `/v3/groups/18c56ebeac084b6e8266822fe0f526dd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.873727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] RBAC: Authorizing `identity:get_group(group_id=18c56ebeac084b6e8266822fe0f526dd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:10.875223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:10.877032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 184/380] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/groups/18c56ebeac084b6e8266822fe0f526dd => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:10.884084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:10.927814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 197/381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:10.929357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda2420-d61f-40be-985b-c37ba54a70c1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.929657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda2420-d61f-40be-985b-c37ba54a70c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.929937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda2420-d61f-40be-985b-c37ba54a70c1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.932318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 198/382] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:10.937850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:10.938175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:10.938425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:10.958494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:10.959705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:11.025771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8c6c-8baf-4a69-b9b3-6fed6057f72c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.048356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 199/383] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:11.049366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.083398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.084093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.084382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.084660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.085508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] RBAC: Adding query filter params (group.id=18c56ebeac084b6e8266822fe0f526dd, role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=5555f070d6fd48a3923494f663482206) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:11.085826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:11.087292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:11.095872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 185/384] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:10 2022] GET /identity/v3/role_assignments?group.id=18c56ebeac084b6e8266822fe0f526dd&scope.project.id=5555f070d6fd48a3923494f663482206&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:11.100920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.109356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:11.185189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:11.208589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93da0c-1e29-4d3d-9694-3356f3bc2334 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.286480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.287344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.287627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.287924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.288284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0716-d6ce-468a-9eeb-6f27430a78b4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.315189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:11.330427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:11.331399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:11.332236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:11.332836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 200/385] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:11.338021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.339476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.340551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.341081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.341561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.353553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:11.361837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:11.362745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:11.364156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:11.367083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 186/386] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:11.373314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.478933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:11.484935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74859-a7ea-48ae-89ee-695dcccce082 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.516886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:11.522489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.523172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.523459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.523743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.524534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:11.524853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:11.526252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:11.526700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b6d6b-5b9b-4cc3-accb-721236be6cab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.535624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 187/387] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:11.540780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.572132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.573132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.573479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.573836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.575057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:11.575386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:11.577310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:11.589884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 201/388] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:11.595723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.725971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd59c0c-22f5-4125-a358-fb831ec91aff None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.766378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.767353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.767641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.767946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.769178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:11.772012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:11.773986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 188/389] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:11.781014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.781187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6660ad-2f62-4138-93de-5ea9ff8751ff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:11.831230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:11.849471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:11.850392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:11.850681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:11.850956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:11.853833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:11.855290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:11.856968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 202/390] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:11.862255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:11.904231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:11.963924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba345f-077b-4130-94ca-f8361a9e5dea None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:12.031877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:12.033046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:12.033540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:12.034016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:12.036137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:12.037872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:12.044155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 189/391] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:12.045801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:12.047239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b21c7a-2849-4a26-8b39-b1eae440f2b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:12.113170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:12.115431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:12.119684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:12.120181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:12.123368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:12.125052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:12.127057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 203/392] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:11 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:12.137515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:12.195388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:12.202802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514e278-da63-482d-b47d-16a7fed333e1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:12.248594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0d58-53c6-48ed-943c-875e5c5a49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:12.249496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0d58-53c6-48ed-943c-875e5c5a49c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:12.249779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0d58-53c6-48ed-943c-875e5c5a49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:12.250053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0d58-53c6-48ed-943c-875e5c5a49c9 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322/groups/2d3265968e324660a5e90d7c39b0c82f/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:12.252153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0d58-53c6-48ed-943c-875e5c5a49c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e18d972836416e8f3752123e2d3322, group_id=2d3265968e324660a5e90d7c39b0c82f, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:12.253584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0d58-53c6-48ed-943c-875e5c5a49c9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:12.276413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97d66-a23f-40f1-84fe-6b8a61dc05ba None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:12.279893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:12.282357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 190/393] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 18:25:12 2022] PUT /identity/v3/projects/62e18d972836416e8f3752123e2d3322/groups/2d3265968e324660a5e90d7c39b0c82f/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:25:12.320951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a457-8d64-4623-bf38-1ef0c6403741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:12.321905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a457-8d64-4623-bf38-1ef0c6403741 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:12.322193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a457-8d64-4623-bf38-1ef0c6403741 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:12.322467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a457-8d64-4623-bf38-1ef0c6403741 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322/groups/2d3265968e324660a5e90d7c39b0c82f/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:12.324769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a457-8d64-4623-bf38-1ef0c6403741 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e18d972836416e8f3752123e2d3322, group_id=2d3265968e324660a5e90d7c39b0c82f, role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:12.326330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a457-8d64-4623-bf38-1ef0c6403741 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:12.343815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 204/394] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 18:25:12 2022] PUT /identity/v3/projects/62e18d972836416e8f3752123e2d3322/groups/2d3265968e324660a5e90d7c39b0c82f/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:25:13.185549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ec0dc-824f-4ecc-8a75-05ed31650833 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.185890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ec0dc-824f-4ecc-8a75-05ed31650833 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.186092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ec0dc-824f-4ecc-8a75-05ed31650833 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.187684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 191/395] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:13.194772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0173f3-c8d7-4594-9e43-56ebafb5ce48 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.195267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0173f3-c8d7-4594-9e43-56ebafb5ce48 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.195351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0173f3-c8d7-4594-9e43-56ebafb5ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.216896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4c0173f3-c8d7-4594-9e43-56ebafb5ce48 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:13.218112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4c0173f3-c8d7-4594-9e43-56ebafb5ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:13.295562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 205/396] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:13.338940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ec0dc-824f-4ecc-8a75-05ed31650833 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:13.422868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1c93-a63f-4acd-b5c6-f98e06afc4dd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.423207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1c93-a63f-4acd-b5c6-f98e06afc4dd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.423438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1c93-a63f-4acd-b5c6-f98e06afc4dd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.425178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 206/397] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:13.431017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.431568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.432106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.454802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:13.456432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:13.496533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ec0dc-824f-4ecc-8a75-05ed31650833 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:13.558517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 207/398] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:13.561224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:13.562044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.562332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.562610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.588455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:13.595228 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:13.596608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:13.598121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:13.598990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 192/399] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:13.612350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:13.617959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:13.639354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:13.733278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c13cc-0c80-4e49-80a6-d784d2732106 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:13.766491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0a521-c5fa-4a72-bae7-681333d0546e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:13.790838 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:13.791503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.791786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.792084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.792835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:13.793143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:13.794510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:13.809315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 193/400] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:13.817402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:13.844435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:13.845657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.846160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.846645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.858618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:13.867357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:13.868361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:13.869161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:13.871943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 208/401] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:13.881163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:13.912522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:13.938307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1b8fe-e7ee-4ab1-b5ac-d4d81ffa6e32 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:13.970815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:13.976526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdfaec-1d80-4197-b3b3-785b9bcdbbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:13.977395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdfaec-1d80-4197-b3b3-785b9bcdbbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.977676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdfaec-1d80-4197-b3b3-785b9bcdbbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.977949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdfaec-1d80-4197-b3b3-785b9bcdbbe0 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.979750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdfaec-1d80-4197-b3b3-785b9bcdbbe0 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:13.981325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdfaec-1d80-4197-b3b3-785b9bcdbbe0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:13.983439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 194/402] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:13 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:13.987884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1328ea-1db8-4925-b136-33113c7360cd None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:13.987884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1328ea-1db8-4925-b136-33113c7360cd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:13.987884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1328ea-1db8-4925-b136-33113c7360cd None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:13.987884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 195/403] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:13.989363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1328ea-1db8-4925-b136-33113c7360cd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.014725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3b631-353c-43d7-b088-cd3727d85541 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.054589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.055276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.055666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.055979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.056845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:14.057159 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.058644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9799a-b63a-45d9-bb5a-cfdd3e0b26f1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.072532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 209/404] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:14.073939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.074234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.074606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.092915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:14.094105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:14.100331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1328ea-1db8-4925-b136-33113c7360cd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.136181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.137027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.137311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.137683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.138871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.140447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.142539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 196/405] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:13 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:14.143325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.159483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:14.167230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 210/406] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:14.168341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.230330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:14.249738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f083-d4f5-4411-bf8a-706ec017cd27 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.271115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea38ee-2952-4798-94ab-e614d32d2b61 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.286915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.287603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.288021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.288305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.289493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.291144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.297198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 197/407] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:14 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:14.297198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.319865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379a81-2734-4282-8321-3181a949d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.319865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379a81-2734-4282-8321-3181a949d451 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.319865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379a81-2734-4282-8321-3181a949d451 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.319865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379a81-2734-4282-8321-3181a949d451 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54/groups/2d3265968e324660a5e90d7c39b0c82f/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.322455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80379a81-2734-4282-8321-3181a949d451 None admin] RBAC: Authorizing `identity:create_grant(project_id=88182820589348c0b422c66f88272a54, group_id=2d3265968e324660a5e90d7c39b0c82f, role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.324283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80379a81-2734-4282-8321-3181a949d451 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.343754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 211/408] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 18:25:14 2022] PUT /identity/v3/projects/88182820589348c0b422c66f88272a54/groups/2d3265968e324660a5e90d7c39b0c82f/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:14.349541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379a81-2734-4282-8321-3181a949d451 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.380739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:14.409330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eab34-d325-4c62-a769-ed03b18e76a5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.493655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379a81-2734-4282-8321-3181a949d451 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.512660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.513899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.514385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.514858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.530759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:14.536892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.537973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.538428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.538893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.540345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.541953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.544188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 212/409] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:14 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:14.549203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:14.550544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:14.569404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:14.570360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:14.571159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 198/410] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:14.577035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.679504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6b64b-3be0-4cbc-9033-768cd720319f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.701742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3d05f-2485-499f-a67d-69ac38eb638e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.718608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.723874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.723874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.723874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54/groups/2d3265968e324660a5e90d7c39b0c82f/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.723874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] RBAC: Authorizing `identity:create_grant(project_id=88182820589348c0b422c66f88272a54, group_id=2d3265968e324660a5e90d7c39b0c82f, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.724295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.740173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 213/411] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 18:25:14 2022] PUT /identity/v3/projects/88182820589348c0b422c66f88272a54/groups/2d3265968e324660a5e90d7c39b0c82f/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:25:14.758523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.759600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.760108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.760601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.761545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:14.762048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.763687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.775325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 199/412] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:14.780811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.867998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:14.923254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff13ea-9c8d-45b0-b43b-d89ff4bfe642 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:14.960763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d0559-eb0b-4b6e-937f-f8d7e538cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:14.961642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0559-eb0b-4b6e-937f-f8d7e538cea4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:14.961928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0559-eb0b-4b6e-937f-f8d7e538cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:14.962209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0559-eb0b-4b6e-937f-f8d7e538cea4 None admin] PATH_INFO: `/v3/groups/18c56ebeac084b6e8266822fe0f526dd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:14.963415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d0559-eb0b-4b6e-937f-f8d7e538cea4 None admin] RBAC: Authorizing `identity:get_group(group_id=18c56ebeac084b6e8266822fe0f526dd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:14.964906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d0559-eb0b-4b6e-937f-f8d7e538cea4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:14.966860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 214/413] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:14 2022] GET /identity/v3/groups/18c56ebeac084b6e8266822fe0f526dd => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:14.972207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:14.976321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.003420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d279b0-05a2-4b98-94da-1324d1013be0 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.003734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d279b0-05a2-4b98-94da-1324d1013be0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.004706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d279b0-05a2-4b98-94da-1324d1013be0 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.006825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 215/414] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:15.012376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6889-fdb7-4c21-a2c2-c6a18e493c29 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.012663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6889-fdb7-4c21-a2c2-c6a18e493c29 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.012944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6889-fdb7-4c21-a2c2-c6a18e493c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.033552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-616e6889-fdb7-4c21-a2c2-c6a18e493c29 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:15.034833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-616e6889-fdb7-4c21-a2c2-c6a18e493c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:15.114723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 216/415] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:15.134115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f73f3-d673-46a2-9647-c0b7f1792d3f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.140726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5daaa-1373-4b4f-8387-9e7bb20e16ba None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.141018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5daaa-1373-4b4f-8387-9e7bb20e16ba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.141295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5daaa-1373-4b4f-8387-9e7bb20e16ba None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.143049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 217/416] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:15.143755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5daaa-1373-4b4f-8387-9e7bb20e16ba None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.190322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09bfd8-86a6-413c-b411-696757f65e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.191670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09bfd8-86a6-413c-b411-696757f65e73 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.192005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09bfd8-86a6-413c-b411-696757f65e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.192279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09bfd8-86a6-413c-b411-696757f65e73 None admin] PATH_INFO: `/v3/projects/5555f070d6fd48a3923494f663482206` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.194349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09bfd8-86a6-413c-b411-696757f65e73 None admin] RBAC: Authorizing `identity:get_project(project_id=5555f070d6fd48a3923494f663482206)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:15.196127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09bfd8-86a6-413c-b411-696757f65e73 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:15.202311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 200/417] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:14 2022] GET /identity/v3/projects/5555f070d6fd48a3923494f663482206 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:15.202311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.202311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.202311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.216603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.222290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:15.225133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:15.277023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5daaa-1373-4b4f-8387-9e7bb20e16ba None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.312101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.315979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.317463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.323875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 201/418] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:15.323875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.324530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.325077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.349308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:15.363740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:15.365008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:15.365833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:15.368581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 218/419] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:15.369653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.441032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e6002-f367-45ad-b1f9-b05fbe7044f1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.480762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.482060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.482603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.483111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] PATH_INFO: `/v3/projects/5555f070d6fd48a3923494f663482206/groups/18c56ebeac084b6e8266822fe0f526dd/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.485381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] RBAC: Authorizing `identity:create_grant(project_id=5555f070d6fd48a3923494f663482206, group_id=18c56ebeac084b6e8266822fe0f526dd, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:15.487024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:15.495284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc35d3-145d-4b5b-8489-1dacb3e607fd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.512499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 202/420] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 18:25:15 2022] PUT /identity/v3/projects/5555f070d6fd48a3923494f663482206/groups/18c56ebeac084b6e8266822fe0f526dd/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:15.513342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.527946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.583267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.584019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.584307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.584816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.611114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:15.621569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:15.622541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:15.623400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:15.624064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 219/421] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:15.631455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.668479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.743967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99410b9d-b7c7-4166-bc1a-ae823707b432 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.760516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9c306-c4cc-4adf-ada5-29c0665777fc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.787300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.788426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.788855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.789314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.790242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:15.790707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:15.792393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:15.804392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 203/422] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:15.810877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.813960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.814958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.817557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.817557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:15.818106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:15.818435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:15.819862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:15.838330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 220/423] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:15.848925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:15.933016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27c0ab-f21b-4f87-ac88-677bbc86a48e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:15.960213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.961116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:15.973582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:15.974894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:15.975383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:15.975889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:16.050576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:16.053285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:16.151317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddf52b-9f63-4cf5-995c-d9f3db4716d3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:16.174044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 204/424] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:25:16.179879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:16.193508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:16.194410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:16.194844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:16.195278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:16.230394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:16.265391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:16.267233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:16.305417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:16.378348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 221/425] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:16.386756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:16.425923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f6ec-def7-41a1-80bb-37f906ad1dae None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:16.499537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9c16-be21-4bb9-bab2-ebb256b1e174 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:16.514812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:16.515673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:16.516011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:16.516525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:16.517453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:16.518885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:16.525030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 205/426] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:16 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:16.528774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:16.548270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:16.551873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:16.552936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:16.553381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:16.553803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] PATH_INFO: `/v3/projects/62e18d972836416e8f3752123e2d3322` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:16.556067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] RBAC: Authorizing `identity:get_project(project_id=62e18d972836416e8f3752123e2d3322)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:16.557706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:16.560039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 222/427] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:16 2022] GET /identity/v3/projects/62e18d972836416e8f3752123e2d3322 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:16.567883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:16.703077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b43f47-0236-4652-8d6c-12319c8d26b2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:16.734709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:16.749521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:16.750014 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:16.750299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:16.750576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:16.753204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:16.759856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8ead5-e50e-4b64-aa6f-bc5a7b0a8584 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:16.760362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:16.762384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 223/428] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:16 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:16.783095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:16.823883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:16.824759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:16.825064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:16.825410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:16.826601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:16.828062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:16.830113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 206/429] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:16 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:16.837199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:16.917296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:16.953899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2981d-cb6e-43e9-9a3a-8e7b55939023 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:16.999718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.000423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.000710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.000990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.001832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=62e18d972836416e8f3752123e2d3322) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:17.002148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:17.003602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc24f9f-17be-4ba3-829e-356d133195cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:17.010980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 224/430] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:16 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=fde1ffae211846158ce1303a9da8610d => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:17.077971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949a78d-76dd-48ee-ab0e-da6eadf13417 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.084554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd327-b8a7-4de9-afa0-ff7abe43aed2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.084929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd327-b8a7-4de9-afa0-ff7abe43aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.085285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd327-b8a7-4de9-afa0-ff7abe43aed2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.086970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 225/431] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:17.092727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.093006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.093288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.117383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.118051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.118333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.118611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.119454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=62e18d972836416e8f3752123e2d3322) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:17.119767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:17.121355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ef31f-995a-4cad-a1d7-11f8a02ebb7c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:17.124945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:17.126184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:17.128380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 207/432] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:16 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=62e18d972836416e8f3752123e2d3322&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:17.151156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420067-8338-449e-804b-d5f9efb49d9f None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.151441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420067-8338-449e-804b-d5f9efb49d9f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.151719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420067-8338-449e-804b-d5f9efb49d9f None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.153219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 208/433] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:17.159065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.159396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.159625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.179212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:17.180501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:17.200699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:17.264956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 209/434] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:17.267881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 226/435] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:17.290540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:17.300323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:17.385393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:17.411984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f596-2ca8-4085-8523-b5968c922723 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.447051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71764-ea60-4052-94af-14756dea20c0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.461636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.462461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.462730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.463080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.475151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:17.485307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:17.486205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:17.487003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 210/436] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:17.491496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:17.496503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.497584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.498062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.498347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.508629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:17.516574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:17.527992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:17.528896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:17.529693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 227/437] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:17.537362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:17.611064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5506a7-3c5c-4f99-ab70-ae61cd289618 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.655076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.655747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.656091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.656366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.657123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:17.657431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:17.658803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:17.668517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 211/438] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:17.674624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:17.677484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21e5e-55fa-4fd0-87da-d6efb0db907b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.703350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:17.724113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.724789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.725076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.725352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.726160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:17.726546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:17.728097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:17.738627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 228/439] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:17.743682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:17.764269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:17.800406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e482-bcbf-49a8-97db-252c94425cbe None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.847600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0bb41-49ac-4ed0-9942-7d695abbc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.848202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0bb41-49ac-4ed0-9942-7d695abbc393 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.848636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0bb41-49ac-4ed0-9942-7d695abbc393 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.849021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0bb41-49ac-4ed0-9942-7d695abbc393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.874446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ef1e9-8dc3-4502-8189-15e88c1e87d7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:17.913678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd8df4-301e-4ac6-a72e-f72077af629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:17.914609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8df4-301e-4ac6-a72e-f72077af629b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:17.914891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8df4-301e-4ac6-a72e-f72077af629b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:17.915174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8df4-301e-4ac6-a72e-f72077af629b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:17.921467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0bb41-49ac-4ed0-9942-7d695abbc393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:17.922924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0bb41-49ac-4ed0-9942-7d695abbc393 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:17.974316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:17.992948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd8df4-301e-4ac6-a72e-f72077af629b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:17.994623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd8df4-301e-4ac6-a72e-f72077af629b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:17.999339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.031016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 212/440] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:18.032301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23566744-c02d-45c9-bdef-75e1f672a63e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.032590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23566744-c02d-45c9-bdef-75e1f672a63e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.032871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23566744-c02d-45c9-bdef-75e1f672a63e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.036262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 213/441] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:18.036764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23566744-c02d-45c9-bdef-75e1f672a63e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.106719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 229/442] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:25:18.108036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.108333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.108621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.125693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:18.126877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:18.140892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23566744-c02d-45c9-bdef-75e1f672a63e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.173763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.174611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.174892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.175163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.176627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.178048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.179732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 214/443] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:18.180507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.198413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 230/444] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:18.199237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.214538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.224843 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.280981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162922c-f799-4a7c-a937-31008591b551 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.300339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a875e-27b8-44e0-b329-d3b9f2338ca7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.314663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f130-32e6-46c1-9245-142147148167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.315527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f130-32e6-46c1-9245-142147148167 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.315813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f130-32e6-46c1-9245-142147148167 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.316762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f130-32e6-46c1-9245-142147148167 None admin] PATH_INFO: `/v3/projects/88182820589348c0b422c66f88272a54` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.318521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970f130-32e6-46c1-9245-142147148167 None admin] RBAC: Authorizing `identity:get_project(project_id=88182820589348c0b422c66f88272a54)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.320010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970f130-32e6-46c1-9245-142147148167 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.321712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 215/445] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/projects/88182820589348c0b422c66f88272a54 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:18.322469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f130-32e6-46c1-9245-142147148167 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.342068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.342921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.343202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.343475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.344682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.346124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.348088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 231/446] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:18.348811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.426864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f130-32e6-46c1-9245-142147148167 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.429351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.439217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.448312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750285-0cde-4e7f-ba96-12fd71fae8ca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.465240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.466033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.466319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.466598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.477031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:18.481395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.482238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.482525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.482802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] PATH_INFO: `/v3/groups/2d3265968e324660a5e90d7c39b0c82f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:18.484708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:18.485608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:18.486439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:18.487649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] RBAC: Authorizing `identity:get_group(group_id=2d3265968e324660a5e90d7c39b0c82f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.487720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 216/447] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:18.487720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.488525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.489661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 232/448] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/groups/2d3265968e324660a5e90d7c39b0c82f => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:18.492087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.587790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384346-5068-4b79-90ef-ed273b925215 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.588263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be1de5-3f80-484d-b707-4bb06ef05335 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.620169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.620804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.621087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.621367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.621885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.622188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=fde1ffae211846158ce1303a9da8610d, scope.project.id=88182820589348c0b422c66f88272a54) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:18.622498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.622593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.622820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.623102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.623873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:18.623978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.624195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.625570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.630244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 217/449] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=88182820589348c0b422c66f88272a54&role.id=fde1ffae211846158ce1303a9da8610d => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:18.631020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.644089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 233/450] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:18.650379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:18.666245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.673353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:18.757147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf227d-36b1-4147-8098-4e98d16bc46c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.764524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223b6f-524f-4a59-9031-b060113c699a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:18.799269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.799973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.800261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.800633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.801637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] RBAC: Adding query filter params (group.id=2d3265968e324660a5e90d7c39b0c82f, role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=88182820589348c0b422c66f88272a54) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:18.801952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.803135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:18.803390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.803785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:18.804104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:18.804381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:18.811051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 218/451] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/role_assignments?group.id=2d3265968e324660a5e90d7c39b0c82f&scope.project.id=88182820589348c0b422c66f88272a54&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:18.890183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:18.891712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:18.907679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:19.011537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 234/452] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:25:19.017673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:19.116319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:19.120808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fea3d-edc8-4a59-87d3-4ac09abe6a53 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:19.155417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:19.156240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:19.156524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:19.156805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] PATH_INFO: `/v3/projects/5555f070d6fd48a3923494f663482206` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:19.157991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] RBAC: Authorizing `identity:get_project(project_id=5555f070d6fd48a3923494f663482206)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:19.159428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:19.161285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 219/453] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:25:19 2022] GET /identity/v3/projects/5555f070d6fd48a3923494f663482206 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:19.166735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:19.262349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09e61-54de-44a5-b333-d99966a732b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:19.274747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:19.295075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d1872-8ef7-4b4d-923e-3f70c952a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:19.295942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1872-8ef7-4b4d-923e-3f70c952a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:19.296227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1872-8ef7-4b4d-923e-3f70c952a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:19.296501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1872-8ef7-4b4d-923e-3f70c952a1b5 None admin] PATH_INFO: `/v3/groups/18c56ebeac084b6e8266822fe0f526dd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:19.297646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d1872-8ef7-4b4d-923e-3f70c952a1b5 None admin] RBAC: Authorizing `identity:get_group(group_id=18c56ebeac084b6e8266822fe0f526dd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:19.299083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d1872-8ef7-4b4d-923e-3f70c952a1b5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:19.301273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 235/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 18:25:19 2022] GET /identity/v3/groups/18c56ebeac084b6e8266822fe0f526dd => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:19.307133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:19.403660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b4158-4f8c-4fb3-93ac-b862db28a92a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:19.437419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:19.438000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:19.438288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:19.438567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:19.439398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] RBAC: Adding query filter params (group.id=18c56ebeac084b6e8266822fe0f526dd, role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=5555f070d6fd48a3923494f663482206) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:19.439714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:19.441643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c351-0ff6-40c5-8a1c-8d971ccd2298 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:19.447320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 220/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 18:25:19 2022] GET /identity/v3/role_assignments?group.id=18c56ebeac084b6e8266822fe0f526dd&scope.project.id=5555f070d6fd48a3923494f663482206&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:22.092726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24709b5-61ce-45e0-a1c3-fb457a36d65c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.093200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24709b5-61ce-45e0-a1c3-fb457a36d65c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.093200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24709b5-61ce-45e0-a1c3-fb457a36d65c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.094790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 236/456] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:22.100441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.101315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.101789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.125137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:22.126695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:22.136120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174e6f0-fbb6-4200-98dd-35bd425ade3b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.136745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174e6f0-fbb6-4200-98dd-35bd425ade3b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.137241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174e6f0-fbb6-4200-98dd-35bd425ade3b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.139305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 237/457] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:22.149865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1407db8-bf77-4590-a578-f4580e95d22d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.150619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1407db8-bf77-4590-a578-f4580e95d22d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.151119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1407db8-bf77-4590-a578-f4580e95d22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.174276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:22.181934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c1407db8-bf77-4590-a578-f4580e95d22d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:22.183149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c1407db8-bf77-4590-a578-f4580e95d22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:22.247083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 221/458] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:22.271760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.337514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 238/459] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:22.357860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65fa8e-37cc-4116-9a10-a15e2330ea0f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.358116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65fa8e-37cc-4116-9a10-a15e2330ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.358362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65fa8e-37cc-4116-9a10-a15e2330ea0f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.360018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 239/460] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:22.365119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.365417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.365701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.379045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46927e99-6198-4b07-869e-f24c150cb495 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.383520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:22.385000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:22.414662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:22.415620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.415937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.416221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.428891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:22.430736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:22.453961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:22.455141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:22.456017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:22.456017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:22.456017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:22.456017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:22.456017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 222/461] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:22.456335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.458614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 240/462] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:22.468930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.470892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:22.569109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:22.571715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50fd9-5184-4e4c-8159-48d3d94f08d0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.606802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d0b4-e35b-4d3a-9f3b-130d3118f61f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.618508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:22.619522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.619809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.620116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.635227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:22.637328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:22.643757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:22.644779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.645272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.645759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.646715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:22.647227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:22.648988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:22.658516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:22.659360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:22.661092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:22.661092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:22.661092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:22.661092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:22.661322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 223/463] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:22.662056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.665201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 241/464] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:22.666417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.739197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:22.788548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96650c61-2287-4ce7-9839-3ba09901a1f2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.794000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:22.797573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769aac6-9aa8-43d9-babf-1070e22bfc63 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.828040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:22.829127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.829410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.829681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.836992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:22.837649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.838046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.838329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.839127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:22.839351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:22.840225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:22.840746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:22.841662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:22.857372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 242/465] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:22.857972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c8bc792f-09f7-4f5f-861e-112c3f3318f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:22.859123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:22.860000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:22.860850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:22.860850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:22.860850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:22.860850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:22.860850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 224/466] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:22.861825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e378bf8-bbdd-44e4-b79e-ed1f52c82d42 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:22.862141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e378bf8-bbdd-44e4-b79e-ed1f52c82d42 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:22.862425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e378bf8-bbdd-44e4-b79e-ed1f52c82d42 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:22.864252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 225/467] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:22.865333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e378bf8-bbdd-44e4-b79e-ed1f52c82d42 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:22.966682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26329eb-c502-4362-bc8a-6955546e202f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.973429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e378bf8-bbdd-44e4-b79e-ed1f52c82d42 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:22.992237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:23.001548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.002222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.002510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.002787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.003645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.005610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.011776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e829560-b5fd-4c00-884b-7662fc48271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.012489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e829560-b5fd-4c00-884b-7662fc48271e None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.012778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e829560-b5fd-4c00-884b-7662fc48271e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.013060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e829560-b5fd-4c00-884b-7662fc48271e None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.013775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e829560-b5fd-4c00-884b-7662fc48271e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.015334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e829560-b5fd-4c00-884b-7662fc48271e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.032245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 243/468] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:25:22 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:23.033149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.046987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 226/469] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:25:22 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:23.048730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496022-43ba-4e7d-aa6a-e8c0e822a1a1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.049220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496022-43ba-4e7d-aa6a-e8c0e822a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.049680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496022-43ba-4e7d-aa6a-e8c0e822a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.063276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:23.074344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4e496022-43ba-4e7d-aa6a-e8c0e822a1a1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:23.075863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4e496022-43ba-4e7d-aa6a-e8c0e822a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:23.180624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01e5e-d302-4f8f-a523-2bd635e38cd9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.184722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 227/470] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:23.187021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecdd96-2833-4e6c-a560-993874771954 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.187562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecdd96-2833-4e6c-a560-993874771954 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.188069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecdd96-2833-4e6c-a560-993874771954 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.189690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 228/471] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:23.196311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.196913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.197405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.215070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:23.216833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:23.233183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.234142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.234595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.235031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.235995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:23.236463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.238203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.252429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 244/472] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:23.254674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.313236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 229/473] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:23.314297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.352463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:23.354916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:23.388561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31449f4d-3c1d-4ac2-bfa3-8c515c7679e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.434326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.435720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.436133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.436762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.442326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9dde7-50cb-456d-9a77-5b899eccdc5d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.451427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.453655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.479811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.480771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:23.481171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:23.482069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:23.482920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:23.482920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:23.482920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:23.482920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.483141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 245/474] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:23.483660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.484144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.484498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.485353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.486991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.511618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 230/475] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:25:23 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:23.512924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.604181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5ee0-9f3f-4685-a29c-8e01d84c590f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.621294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:23.637579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644867c-8812-483e-adc3-0926b053d0f9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.638204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:23.648199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.648879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.649165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.649444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.650262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.651808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.659214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.sql.core [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 18:25:23.659214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 18:25:23.659214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [parameters: {'id': '982dc6d001a44aaebd5aaa93c97e1fd4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 18:25:23.659214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 18:25:23.683754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jun 22 18:25:23.683993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 18:25:23.684915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application yield resource Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise self.value Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application session.commit() Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 18:25:23.685843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.flush() Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application compat.raise_( Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 18:25:23.686698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 18:25:23.687581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 18:25:23.688431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [parameters: {'id': '982dc6d001a44aaebd5aaa93c97e1fd4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:23.689225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 18:25:23.690010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.690916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 246/476] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 18:25:23 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:23.692588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.693663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.694166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.694671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.695682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:23.696370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.698133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.712907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 231/477] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:23.718799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.828600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ea7f-842d-4ef3-91ca-7b2351ebdd3c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.844591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59ded1-7898-42c2-8f88-ea1dfbb6a8a1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:23.875242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.876130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.876595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.876873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.887209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e555-20b3-4942-8d1a-04b76991142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:23.888253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e555-20b3-4942-8d1a-04b76991142b None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:23.888758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e555-20b3-4942-8d1a-04b76991142b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:23.889243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e555-20b3-4942-8d1a-04b76991142b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:23.889981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:23.890366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323e555-20b3-4942-8d1a-04b76991142b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:23.893017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323e555-20b3-4942-8d1a-04b76991142b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:23.898269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:23.899164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 18:25:23.900012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:23.901128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 247/478] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:25:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:23.906242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:23.923160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 232/479] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:25:23 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:25:23.971752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:24.027531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f51123-807a-4581-a183-65fbd67cd94a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:24.065652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:24.068597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:24.068934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:24.069206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:24.069938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:24.070248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:24.071663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af8970-d06a-4cf2-9e72-1de153269dc2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:24.088016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 248/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:25.593132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4186-eb2e-4b9b-805f-f101c616da1a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:25.593651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4186-eb2e-4b9b-805f-f101c616da1a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:25.593725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4186-eb2e-4b9b-805f-f101c616da1a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:25.595699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 233/481] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:25.603384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b478a7-408c-4c03-b566-576869a70797 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:25.603945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b478a7-408c-4c03-b566-576869a70797 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:25.604337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b478a7-408c-4c03-b566-576869a70797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:25.632101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7b478a7-408c-4c03-b566-576869a70797 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:25.633587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7b478a7-408c-4c03-b566-576869a70797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:25.709452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 249/482] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:25.755540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4186-eb2e-4b9b-805f-f101c616da1a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:25.760671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f363-513f-44fa-a68e-c16837bd8297 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:25.760964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f363-513f-44fa-a68e-c16837bd8297 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:25.761251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f363-513f-44fa-a68e-c16837bd8297 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:25.764109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 250/483] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:25.765363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:25.772415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:25.775930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:25.775930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:25.795141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:25.797671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:25.853714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:25.887859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 251/484] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:25.920165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.017761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4186-eb2e-4b9b-805f-f101c616da1a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.079530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.080858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.081182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.081510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.104572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:26.114994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:26.115954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:26.116773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:26.123568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 234/485] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:26.129522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.148490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d85de-0a2a-4c56-b3cd-1906cfc0589c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.264492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963225-8664-4fb7-b965-c99dce07bf7f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.273159 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.273989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.274278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.274556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.292243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:26.303462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:26.311775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:26.313849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:26.314846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 252/486] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:26.325316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.337679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.338411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.338695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.338969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.339789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:26.340129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:26.341516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:26.357304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 235/487] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:26.365568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.405407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:26.500711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a979bb-08b2-4797-b643-b1802b0aa500 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.547233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.547968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.548252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.548526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.549280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:26.549593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:26.551713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:26.564888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 253/488] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:26.566727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.628698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d0c0c-1da9-4d25-a766-d77c28bc4919 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.654513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:26.664409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.665196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.665482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.665762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.676951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:26.678409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:26.681252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:26.689124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52e5-554f-46ca-8dc0-26205388de5c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-dec1f98c-b61a-470a-b431-4cb37cd2f7b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:26.697854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:26.698682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:26.699541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:26.699541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:26.699541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:26.699541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:26.700182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 236/489] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:26.701604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427b83-3e07-4819-b2cf-4d5c9244021e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.701899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427b83-3e07-4819-b2cf-4d5c9244021e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.702181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427b83-3e07-4819-b2cf-4d5c9244021e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.703702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 237/490] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:26.707707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19c7e-1206-410e-9d15-a439902d2376 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.707707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19c7e-1206-410e-9d15-a439902d2376 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.707707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19c7e-1206-410e-9d15-a439902d2376 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.707707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 238/491] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:26.708165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19c7e-1206-410e-9d15-a439902d2376 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.732410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.733211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.733497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.733777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.744516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:26.745967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d026e7ae-a9dd-4349-8695-f1fe66ba57a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:26.766626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:26.767522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:26.768415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:26.768415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:26.768415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:26.768415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:26.773061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 254/492] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:26.774237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a66a-81e6-4e52-ab4e-fd5fb14ca8c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.774524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a66a-81e6-4e52-ab4e-fd5fb14ca8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.774798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a66a-81e6-4e52-ab4e-fd5fb14ca8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.790998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-df76a66a-81e6-4e52-ab4e-fd5fb14ca8c5 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:26.792206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df76a66a-81e6-4e52-ab4e-fd5fb14ca8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:26.826359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19c7e-1206-410e-9d15-a439902d2376 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:26.858362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 255/493] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:26.859743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c0dc-a0ee-4b76-9541-3c39b78a1159 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.860063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c0dc-a0ee-4b76-9541-3c39b78a1159 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.860339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c0dc-a0ee-4b76-9541-3c39b78a1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.869874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:26.870786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.871209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.871620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.872523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:26.873033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:26.874423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:26.885623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1551c0dc-a0ee-4b76-9541-3c39b78a1159 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:26.886706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1551c0dc-a0ee-4b76-9541-3c39b78a1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:26.891869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 239/494] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:26.891869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.930499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:26.966542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 256/495] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:26.968702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67db3-2f4b-4dc8-a431-527ebd3d6ae7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:26.969197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67db3-2f4b-4dc8-a431-527ebd3d6ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:26.969650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67db3-2f4b-4dc8-a431-527ebd3d6ae7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:26.971982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 257/496] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:26.972938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67db3-2f4b-4dc8-a431-527ebd3d6ae7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:26.983261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.000938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6a2a-4319-4e5b-babe-fd8799b5b040 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.035951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.036599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.036883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.037154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.037868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:27.038171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.039527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.051416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 240/497] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:27.052256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.076707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67db3-2f4b-4dc8-a431-527ebd3d6ae7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.111172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ac1a6-4f42-4b45-baa0-501200c31d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.111992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ac1a6-4f42-4b45-baa0-501200c31d91 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.112276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ac1a6-4f42-4b45-baa0-501200c31d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.112551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ac1a6-4f42-4b45-baa0-501200c31d91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.124576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ac1a6-4f42-4b45-baa0-501200c31d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-176ac1a6-4f42-4b45-baa0-501200c31d91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:27.133124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:27.134015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:27.134797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 258/498] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:27.135982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.136197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.136474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.153874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:27.154624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.155429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:27.158868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e3e0-dc65-4fa5-bed8-d3b26dd04c1c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.192762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.193535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.193816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.194087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.202489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.203988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.220118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:27.220890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:27.221926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 241/499] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:27.228225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.228890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 259/500] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:27.228890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.330580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389fd92-264d-47ef-b394-97fc0a25a57b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.333922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38a304-8cf3-4eb7-921b-45e7a32ac1ce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.364048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.364834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.365161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.365404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.367259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.368085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.368370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.368645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.375339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:27.375630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.377143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:27.383304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:27.384232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:27.385031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 242/501] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:27.385696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:27.393067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:27.395123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 260/502] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:27.396274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.408283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.455654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.488212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944ee5-3667-4ba1-a3fb-62468fe4e90a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.496816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9ac1-951f-4700-9074-9fa7118c7663 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.523327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.524017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.524303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.524581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.525322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:27.525681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.527065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.529970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.530633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.530922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.531205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.532075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:27.532391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.533838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.535285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 243/503] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:27.536258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.572629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 261/504] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:27.573800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.616839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.637152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ca14-6ee3-4803-960a-fe491ae8a790 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.670338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.671048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.671334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.671617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.674291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d115d-79ae-4681-9228-5e3ee2f57326 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.682171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.683612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.690119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:27.700995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:27.701835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:27.702704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:27.702704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:27.702704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:27.702704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:27.702704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 244/505] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:27.702974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.714095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.714758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.715041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.715312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.716082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:27.716394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.717777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.726195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 262/506] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:27.726959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.802557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d3c8f-d78c-4790-b696-23560c9e9e34 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.829495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3237-e034-4350-b0d9-dd005a797026 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.831164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.837208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.837865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.838150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.838425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.839298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:27.839608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.841081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.863202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:27.864015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:27.864301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:27.864575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:27.875286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:27.876778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:27.877271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 245/507] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:27.877995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:27.895608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:27.897290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:27.898146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:27.898146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:27.898146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:27.898146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:27.898146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 263/508] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:27.898419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:27.928030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:27.984934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993733e5-f638-4f7b-88b3-98889ede3d5a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:27.997090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d58f6-8371-425b-9bcd-38e2a5fcfa74 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.019504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.020171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.020474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.020723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.030174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.030835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.031125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.031406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.032167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:28.032479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.033858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.046080 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 264/509] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:28.046881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.077781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.089510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.090985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.138369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.149372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d150a-65e3-4366-9cc2-ae0a816e68f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.183056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.183772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.184126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.184402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.197159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 246/510] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:28.197159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.197401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.197401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:28.213379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:28.214225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:28.215072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:28.215072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:28.215072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:28.215072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:28.215072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 265/511] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:28.215338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.285234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.295497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f42b21-b311-418e-abb6-deeb04fa1b73 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.315249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ec-3859-4982-9e8b-ffee9abbaf0c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.330405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.331048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.331390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.332269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.349261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.349919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.350212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.350487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.351208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:28.351522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.352941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.364015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 266/512] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:28.364795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.367384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.400532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.402088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.466686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd1c2-7be0-47ae-89d9-8e69bc13ea62 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.489167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.499345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 247/513] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:28.500179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.504874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.505570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.505879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.506151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.506855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.508595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.528519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 267/514] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:25:28 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:28.529320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.599434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.626799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24bf37-c0ae-42b8-9caa-1a3365d0aad2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.648465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2382f47-f56e-4025-ad9e-e0a817a166dd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.667678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.669194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.669481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.669758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.681207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.682691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.688454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.689121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.689445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.689728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.690455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:28.691023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.692413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:28.702025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:28.702909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:28.703794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:28.703794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:28.703794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:28.703794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:28.703794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 248/515] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:28.704146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.706885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 268/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:28.708079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.758869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.823563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad793f9-6658-4136-9d4d-c038b4108aa8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.823796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169df581-1c7a-4d51-99eb-7c2f5a731671 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:28.846104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:28.860473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.861353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.861641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.861913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.863385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:28.864280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:28.864645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:28.864999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:28.870329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.871771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.875568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:28.877248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:28.889083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:28.889998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:28.890885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 249/517] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:28.891434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:28.899171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:28.900068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:28.900913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:28.900913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:28.900913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:28.900913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:28.906295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 269/518] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:28.906295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.003119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955e33-9710-4aa6-8f4a-575929e1f084 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.005217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.011722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef40e1-af0b-4248-b663-66d091e09759 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.044695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.045702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.045920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.046406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.046530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.046766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.047043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.047396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.048380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:29.048906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.051150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.055354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.056824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.063632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 250/519] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:29.064729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:29.071489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:29.072914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:29.074809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 270/520] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:29.076703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.112190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.183743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a588-1f98-4dfc-9dc5-d24868650077 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.187139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fd3b2-540c-4551-901b-134832dfbf2b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.219581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.220276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.220565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.220831 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.221674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:29.222013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.223453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.224899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.225564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.225853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.226835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.226835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:29.227161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.228584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.246113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 251/521] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:29.246113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.246347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 271/522] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:29.246347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.271900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.355161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.359691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877820bc-5ad8-49a9-b61f-4494554b4314 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.366007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33e73c-82e2-4d09-99e5-d980d2d8082b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.398079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.398860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.399140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.399415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.403721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.404413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.404699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.404977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.406005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:29.406104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.406317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.407503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.407752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:29.422603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:29.423461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:29.424498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 252/523] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:29.425021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.432284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 272/524] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:29.433165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.519755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.534376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb339c4-2d63-4276-8ad3-11c48b38f584 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.540239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a72b9-2a34-468d-a913-a8f9cf7be1a3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.572164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.572753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.572954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.573244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.573400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.573501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.573669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.573945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.580495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.582473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:29.597994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:29.598874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:29.599820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 273/525] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:29.600328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.615528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.652500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.654430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.714663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454adb95-0634-42fe-a80b-93c2db2214be None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.747523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.750626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.751570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.751895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.752212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.753263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:29.753578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.755062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.774699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 274/526] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:29.775558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.786491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 253/527] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:29.786491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.849365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.883642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728459fa-05ab-4dee-93a5-616898297da4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.886534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcdcef-84e3-4a43-ac4c-3514ae807b32 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:29.919532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.920219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.920503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.920776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.921325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:29.921561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:29.921870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.922434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:29.922855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:29.923278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:29.923385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:29.941510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 254/528] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:29.946791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:29.988254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:29.997446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:29.999082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.049114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80984-8537-4ae6-877f-787d1951dde3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.063848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:30.085137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.085783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.086063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.086334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.087166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=fd8232022633460fbaa7479477d4014d) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:30.087477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.088964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.096092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 255/529] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/role_assignments?user.id=fd8232022633460fbaa7479477d4014d&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:30.097562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.119169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 275/530] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:30.120618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.228681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f3737-9a38-4973-8f81-bbdb229d1dce None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.232660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:30.264200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1a3ff-4115-4bd5-be77-2a59c4f78a40 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.271988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.273072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.273530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.274001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.285309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.287378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.306200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.306814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:30.307015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:30.307854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:30.308702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:30.308702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:30.308702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:30.308702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:30.308926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.308926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.308926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=c8d6c2d367804ad5b3802d487efb13ed) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:30.308926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.309983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.311428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 256/531] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:30.312591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.319212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 276/532] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/role_assignments?user.id=c8d6c2d367804ad5b3802d487efb13ed&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:30.326683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.382247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:30.510445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ff219-29ed-4997-b858-a6c7a9b402df None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.515189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710f52-2b1f-4454-bbee-db9e9281af68 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.552525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.553682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.553788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.554276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.554569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.554858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.555137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.555375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.556564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:30.557072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.558656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.566992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.568154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.573083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 277/533] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:30.584909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:30.587755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:30.588610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:30.589959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:30.589959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:30.589959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:30.589959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:30.589959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 257/534] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:30.598164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.620108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:30.688084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:30.699171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33839cb-d73f-44c8-9544-03335da9bf1a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.733127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c410c-7a34-434a-9ae8-eef799a8e83d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.739532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.741025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.741506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.741994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.751605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.754174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3d974b8a-42cf-4eae-9b80-2866f302fbc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:30.773982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:30.774890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:30.775731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:30.780514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 278/535] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:30.780514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1d4a5-a7ac-4fc9-bcd8-9e8dfe63b8f8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.780514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1d4a5-a7ac-4fc9-bcd8-9e8dfe63b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.780514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1d4a5-a7ac-4fc9-bcd8-9e8dfe63b8f8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.780514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 279/536] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:30.783966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1d4a5-a7ac-4fc9-bcd8-9e8dfe63b8f8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.787405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.788109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.788397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.788677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.789419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:30.789731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.792320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94ca1-b028-47c4-8dd5-9c986d48b736 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:30.809323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 258/537] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:30.810836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.811130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.811410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.832720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:30.833944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:30.918423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:30.928520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1d4a5-a7ac-4fc9-bcd8-9e8dfe63b8f8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:30.932256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 259/538] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:30.933008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:30.982679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:30.984311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:30.984798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:30.985287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:30.986416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:30.986925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:30.990208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.009991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 280/539] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:31.009991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.026365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:31.067296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38d33-3a83-435c-befa-88e790f2d404 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.103056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.103859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.104151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.104429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.111725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:31.113790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:31.129180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:31.130063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:31.131492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 260/540] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:31.131982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.140739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bd49a-4655-4b71-91c9-4ad887aa33cb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.188247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.189590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.190327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.191336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.192564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:31.209063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:31.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:31.220477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:31.221249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:31.223908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 281/541] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:31.224920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.247638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c6f8-c1b1-4c7e-912a-defd63608799 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.296032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.297307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.297858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.298400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.299398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=0a7d067e3f3c4f778ec5eedccc202fc7) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:31.300380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:31.302258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.307482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:31.317609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 261/542] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/role_assignments?user.id=0a7d067e3f3c4f778ec5eedccc202fc7&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:31.317609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.370445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e3d9-0056-44b4-af09-2b5b2545a8a1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.441055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.442351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.442868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.444156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.446908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:31.447502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:31.450778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.485742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 282/543] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:31.491588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.531470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13de74-8657-4fde-877d-b5462d38ebd0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.583098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:31.616542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.617590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.618072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.618632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.619611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:31.620136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:31.621717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.621821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9410-7e7d-43c2-936b-c4022e166c20 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.642284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 262/544] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:31.649832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.680206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:31.690143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.691986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.692531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.693023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.694058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=01bb9cc9e4c34504ac6574c28963b4d6) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:31.694569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:31.696254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.718130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 283/545] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/role_assignments?user.id=01bb9cc9e4c34504ac6574c28963b4d6&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:31.764614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acce8-f1e7-4bb4-a533-ae195618960e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:31.802897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:31.803696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:31.804010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:31.804289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:31.817160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:31.818648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:31.837732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:31.838611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:31.839940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:31.839940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:31.839940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:31.839940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:31.839940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 263/546] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:31.845036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:31.967426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ad29-9447-491d-bcfd-f8dd7b49d849 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:32.005707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:32.006694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.007161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.007617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.008841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:32.009347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:32.010951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:32.025220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 284/547] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:32.030927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:32.072803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:32.141966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6b0bc-6f98-4504-ad85-e3758532cdc7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:32.178630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:32.179784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.180326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.180824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.188664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:32.190384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:32.216272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:32.217321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:32.218732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:32.223253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 264/548] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:32.230582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:32.309183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:32.358467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deca6c-6d40-47f0-b4cb-196841df9ee6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:32.395926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:32.396973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.397464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.397943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.398986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:32.399518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:32.401200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e5581-738e-4412-ae6c-a445e15f147c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:32.420314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 285/549] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 18:25:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:32.428948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:32.537426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fcae4-579d-4aa1-b25c-e739460d30de None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:32.539412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:32.577263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:32.577918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.578204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.578480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.593318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4276e-af5e-4071-a34f-d82f770431d1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.593625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4276e-af5e-4071-a34f-d82f770431d1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.593890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4276e-af5e-4071-a34f-d82f770431d1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.595330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 286/550] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:32.605630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96601a-3234-489f-86fb-f2bc022ae033 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.606568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96601a-3234-489f-86fb-f2bc022ae033 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.607405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96601a-3234-489f-86fb-f2bc022ae033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.638209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad96601a-3234-489f-86fb-f2bc022ae033 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:32.641672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad96601a-3234-489f-86fb-f2bc022ae033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:32.693648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:32.695054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:32.717530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 287/551] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:32.718970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec68a-72a5-40a7-9a72-716b17f46d65 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.719269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec68a-72a5-40a7-9a72-716b17f46d65 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.719551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec68a-72a5-40a7-9a72-716b17f46d65 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.725380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 288/552] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:32.726539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:32.726836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:32.727120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:32.745235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:32.746480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:32.813527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:32.826620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:32.835911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 265/553] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:32.836973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:32.848571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 289/554] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:32.849953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:32.966992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359414-35b9-4bd6-be9c-57f05a6dffab None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:32.970471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93772df-95e8-4568-8d7e-897c9aa50511 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.008967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.010143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.010282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.010574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.015583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.016882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.017415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.017956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.022986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:33.030460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.032147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:33.032375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:33.033280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:33.034128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:33.039154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 266/555] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:33.040165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:33.061978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:33.062975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:33.063855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:33.063855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:33.063855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:33.063855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:33.067376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 290/556] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:33.068869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.105206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.105745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.153453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844fd5-b4b7-4595-8f5b-a7dae5f9d669 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.188264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.189201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.189592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.189965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.192819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a082ca-9079-4a07-9f20-1951476acfb9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.201568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:33.210319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:33.211289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:33.212659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:33.216077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 267/557] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:33.216984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.234996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.236000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.236471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.236928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.238566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:33.239064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.240697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.255103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 291/558] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:33.256288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.325893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efd0f6-c240-4964-8689-7fc61936080a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.343771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.362915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.363676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.364070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.364419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.365123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.365233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:33.365960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.367149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.379590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfa5fe-f30c-45ed-a5f1-4e211ed46c06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.380495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 268/559] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:33.381415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.419172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.420224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.420694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.421258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.422196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:33.422688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.424397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.433966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 292/560] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:33.435153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.491734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4e0e-9db3-4fd5-a4fc-2d81e3a8b24f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.530832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.531848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.532234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.532578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.543899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.545570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.549623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912f4f-95dd-48a7-a738-4be409dc546c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:33.566781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:33.567925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:33.568820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:33.568820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:33.568820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:33.568820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:33.578085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 269/561] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:33.578085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.625285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.626098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.626497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.626810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.635972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.637693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.650915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a7aac5d4-71e4-40dc-9eb0-763e3ae7788c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:33.655091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:33.656229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:33.657112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:33.663495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 293/562] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:33.664989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07c6c-db82-4054-9bbd-9e1c8b230e7a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.665293 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07c6c-db82-4054-9bbd-9e1c8b230e7a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.665584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07c6c-db82-4054-9bbd-9e1c8b230e7a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.670935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 294/563] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:33.670935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07c6c-db82-4054-9bbd-9e1c8b230e7a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.682816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.751148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877988-f3f1-4bc8-9f41-87c591c2c33b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.797307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.798989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.799421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.800156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.805383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07c6c-db82-4054-9bbd-9e1c8b230e7a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.813325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.817842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:33.839711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:33.841200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:33.842119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:33.842119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:33.842119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:33.842119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:33.842119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 270/564] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:33.842119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:33.850417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:33.851135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.851422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.851696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.852474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:33.852822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:33.854192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e0b85-f540-4086-9693-f43632ca8169 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:33.869593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 295/565] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:33.870951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:33.871194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:33.871486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:33.889200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:33.890380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:33.958436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.984295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:33.986130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429a42a-f947-4842-bb83-901c232fed7e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:33.991483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 296/566] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:33.995318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.026749 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.027432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.027714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.028020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.028817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:34.029128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.030570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.047363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 271/567] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:34.047363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.112743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f89b-76b6-4451-b24b-21524122c8aa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.146975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.147766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.148143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.148427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.149157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:34.149470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.150864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.156444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa3bb-434a-4b7d-ade9-3870c40a3542 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.167070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 297/568] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:34.167070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.196548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.197399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.197761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.198042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.205855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.207825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.210694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:34.225835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:34.227019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 18:25:34.228254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:34.231653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 272/569] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:34.232047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.233261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.273123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc66b7-419c-4614-9be8-b91192ad3e86 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.305925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.306644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.306932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.307216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.318171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:34.325755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:34.326901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:34.327754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 298/570] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:34.328479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.339332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9c1b-d38c-4311-a147-3bfdd47d4130 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.373213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bf326-970a-452c-b890-550e04de9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.373861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bf326-970a-452c-b890-550e04de9164 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.374150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bf326-970a-452c-b890-550e04de9164 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.374432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bf326-970a-452c-b890-550e04de9164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.375265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bf326-970a-452c-b890-550e04de9164 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=a82d117152a54ebcbd6cf9291bef3f97) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:34.375580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bf326-970a-452c-b890-550e04de9164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.377062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bf326-970a-452c-b890-550e04de9164 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.383157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 273/571] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/role_assignments?user.id=a82d117152a54ebcbd6cf9291bef3f97&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:34.383985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bf326-970a-452c-b890-550e04de9164 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.451561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a2430-888d-4eda-9f44-c0e097a7f2de None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.452899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.477164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.495007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.495822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.496132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.496413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.498435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bf326-970a-452c-b890-550e04de9164 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.505726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.507338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d48dc37d-824f-4ebb-a5d5-105a798d04d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:34.526836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:34.528172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:34.529286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 299/572] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:34.530480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66832-eaea-4245-af8d-0d09174cd939 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.530767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66832-eaea-4245-af8d-0d09174cd939 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.531041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66832-eaea-4245-af8d-0d09174cd939 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.532341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 300/573] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:34.533431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66832-eaea-4245-af8d-0d09174cd939 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.541725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.542673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.543034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.543376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.544795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:34.545180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.547403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.572031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 274/574] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:34.572954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.646574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66832-eaea-4245-af8d-0d09174cd939 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.680519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d04f-2ca8-4b03-8f4e-c744250f51dd None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.682231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.682900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.683195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.683473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.684253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:34.684565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.685938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a913643-3f0d-494a-9ea2-88309a6df481 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.695356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 301/575] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:34.696623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.696915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.697196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.710687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.713756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:34.714947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:34.724228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.725043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.725430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.725806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.726764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:34.727192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.728785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.746436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 275/576] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:34.747254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.757370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.795169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 302/577] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:34.796900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.860804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89eba1-6367-49c7-895b-a8b1e0fe2311 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.902333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.903429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.903918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.904776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.915710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.916996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea20c89-1d6a-4d41-93f3-5dfb311a3d2d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:34.917822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:34.936611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:34.937753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:34.938779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:34.938779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:34.938779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:34.938779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:34.945417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 276/578] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:34.946429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:34.954222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:34.955019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:34.955300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:34.955575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:34.966291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:34.968267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:34.980982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:34.986504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:34.988227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:34.989528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:34.989528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:34.989528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:34.989528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:34.989528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 303/579] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:34.990175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.017797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.060413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dcc8c-1c57-478f-b14f-d7c63e0d0e10 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.097428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.098211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.098491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.098765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.100106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf10657-0d6d-431b-9edb-ed0424e3860c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.109729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.111352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:35.132063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:35.133429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:35.134482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:35.134482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:35.134482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:35.134482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:35.140278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 277/580] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:35.140400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.140511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.140597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.140597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.140597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.151400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:35.159328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:35.160447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:35.161404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 304/581] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:35.162158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.232294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.250413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55241d-fb09-4db5-98b8-184d09cfe130 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.257931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.274693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8c8a-85f5-417e-b109-ceb002514f97 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.289512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.290164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.290446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.290719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.291437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:35.291746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.293142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.305098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 278/582] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:35.305711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.315972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.316796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.317026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.317301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.318027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:35.318338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.319714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.336862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 305/583] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:35.336862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.419884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8312a-0851-4498-932b-f06cd17fdf8a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.438903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88c59-b4b3-42de-a411-d382ba8c516b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.455955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.457324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.457678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.458026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.458850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:35.459409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.460699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.473431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 279/584] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:35.474114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.478798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.481928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.482708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.483064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.483411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.484292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:35.484707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.486236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.501165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 306/585] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:35.502198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.511734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.588772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cc42a-dbde-4b14-b7b4-988f4f51f88f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.619063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d406ce-0aed-46b4-9c80-e1be0d057630 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.625740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.627145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.627526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.628037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.637861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.639932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:35.654640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:35.655651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:35.656900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:35.657366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.657366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.657366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.657366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.660825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 280/586] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:35.661661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.665546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.667990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:35.682922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:35.683894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 18:25:35.684827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:35.688894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 307/587] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:35.689795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.733194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.763055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.779293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608dd88-bcce-4307-a1db-5a8cbfd5f48a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.805866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82d6c0-3a27-4d35-96da-61d5a3cbbbeb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.814114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.814903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.815194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.816080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.822874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.824355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:35.838562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:35.839443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:35.840467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 281/588] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:35.841384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.845928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.847218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.847499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:35.847773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:35.858706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:35.860201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:35.878023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:35.878913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:35.879800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:35.879800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:35.879800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:35.879800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:35.879800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 308/589] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:35.880744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:35.957749 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d59ec-cf4b-40cb-b314-2d61e6e9185d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.984770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:35.997324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cdf89-7c75-46fe-8ab2-20b6b381acac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:35.998086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:35.999002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:35.999290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.000473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.001281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:36.001599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.003636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.015245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.026058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 282/590] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:36.026058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.034684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.035351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.035625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.035954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.037195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:36.037510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.039440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.058068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 309/591] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jun 22 18:25:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:36.059053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.140350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da170-ad41-48ba-a820-8b2e2e900348 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.158431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac582a-293f-473e-96f6-3c6034a6b05a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.176756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.177414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.177701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.177981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.178776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:36.179091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.180583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.199912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 283/592] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:36.199912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.202193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.202862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.203149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.203430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.204194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:36.204512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.205987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.217883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 310/593] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:36.218623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.251344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.261015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.314107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0b5ca-6cac-4842-be3f-80af877964d1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.328410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe963d-fcbf-4987-990e-0db28e03fbf7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.351145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.352441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.353017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.353520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/c8d6c2d367804ad5b3802d487efb13ed/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.363158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.363991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.364280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.364560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.369654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=c8d6c2d367804ad5b3802d487efb13ed, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.371409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.374997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.376854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.386433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 284/594] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:36 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/c8d6c2d367804ad5b3802d487efb13ed/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:36.387413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:36.405645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:36.406604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:36.407495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:36.407495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:36.407495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:36.407495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:36.407495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 311/595] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:36.408382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.505653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.510851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.516283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717bbd1-fee9-4d45-b3dc-490eac8eb114 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.525673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7789-05d1-4c5e-82b3-74929de3a7f7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.563159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deb2b4-71a2-499a-9753-d21849e031dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.564358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deb2b4-71a2-499a-9753-d21849e031dc None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.564645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deb2b4-71a2-499a-9753-d21849e031dc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.564961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deb2b4-71a2-499a-9753-d21849e031dc None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/fd8232022633460fbaa7479477d4014d/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.566690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.567495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.567787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.568105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.575977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.577434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.582757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deb2b4-71a2-499a-9753-d21849e031dc None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=fd8232022633460fbaa7479477d4014d, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.584246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deb2b4-71a2-499a-9753-d21849e031dc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:36.593804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:36.594792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:36.595733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 312/596] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:36.597084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.605652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 285/597] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:36 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/fd8232022633460fbaa7479477d4014d/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:36.606788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26067-c547-429b-9ef4-2927c6c2a311 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.607072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26067-c547-429b-9ef4-2927c6c2a311 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.607349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26067-c547-429b-9ef4-2927c6c2a311 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.618110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 286/598] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:36.624380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26067-c547-429b-9ef4-2927c6c2a311 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.721396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e178a1-9196-42c0-aa4a-17c6bdaa8174 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.759137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26067-c547-429b-9ef4-2927c6c2a311 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.763151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.763676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.764006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.764290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.765034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:36.765349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.767632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb125601-392b-4e4c-94f5-a9c1aaacf565 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.781335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 313/599] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:36.782779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.783652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.783652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.801100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:36.802369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:36.804494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.810341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:36.811065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:36.811254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:36.811538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:36.812847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:36.812847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:36.814196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:36.844047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 287/600] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:36.844955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.848441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:36.884495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 314/601] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:36.886094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:36.984796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066acd1-b91b-4351-8a68-2b9d39feb73f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:36.996192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899b713-2bcf-4755-adc7-70356995b550 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.030109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.031329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.031910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.032403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.033725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.034620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.034913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.035193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.041320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.042614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:37.045031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.046572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.048203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:37.063384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:37.064345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:37.065257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:37.072051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:37.072941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:37.073861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:37.073861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:37.073861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:37.073861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:37.073861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 315/603] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:37.073861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.074946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 288/603] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:37.077124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.151654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:37.191692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec601444-d196-41c0-9019-835b483d9d06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.194220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bc14e-456f-44a3-aa7c-807bdaffdf50 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.227872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.229047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.229369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.229651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.230040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.230866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.231300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.231735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.232707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:37.233169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.234780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.240893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:37.248035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 289/604] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:37.249005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:37.253734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:37.254900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:37.255868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:37.256537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 316/605] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:37.261253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.314908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:37.359480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ca984-ed85-4bd2-adc1-fe8dd3e5d51e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.372154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2198d-a8d5-4c9f-8c01-526cda624a38 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.384308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:37.397409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.398080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.398367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.398654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.399386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:37.399701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.401121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.411944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.413046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.413392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 290/606] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:37.413735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.414231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.414407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/0a7d067e3f3c4f778ec5eedccc202fc7/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.430779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=0a7d067e3f3c4f778ec5eedccc202fc7, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.432622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.456602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 317/607] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:37 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/0a7d067e3f3c4f778ec5eedccc202fc7/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:25:37.458056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.526204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab190-9055-40b7-8606-1cc48de5e500 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.563485 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.564264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.564476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.564760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.566123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:37.566384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.567959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.582612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 291/608] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:37.596145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.596450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:37.600751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001033-fa71-4a21-90fa-4817fe4fd306 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.642962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.644308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.644801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.645233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.653240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.655082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:37.671187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:37.672350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:37.673427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:37.675984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 318/609] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:37.682760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.708148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:37.787224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78fabd-750e-41b2-b631-cde98025a6b1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.804380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506020ce-c76a-4b93-86af-7042fa58971f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:37.841354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.842245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.842779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.843229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.844206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:37.844674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.846263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.856549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:37.857360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:37.857705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:37.857931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:37.860464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 319/610] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:37.869808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:37.871106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.871386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:37.889595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:37.890710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:37.891828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:37.891828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:37.891828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:37.891828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:37.897773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 292/611] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:37.905250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:37.909437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:38.000481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22156a4-d213-4c35-a9ad-82a80863a3b5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:38.064770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:38.066457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.066911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.067340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/01bb9cc9e4c34504ac6574c28963b4d6/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.083373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=01bb9cc9e4c34504ac6574c28963b4d6, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:38.085251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:38.093387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:38.102535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 320/612] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:37 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/01bb9cc9e4c34504ac6574c28963b4d6/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:38.113963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80cde1-77d0-4745-9246-3a8fbc7f6ac1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:38.174382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:38.175166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.175445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.175882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.176619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:38.176955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:38.178436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:38.202084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 293/613] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:38.208320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:38.320190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:38.360407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc84a38-3470-4c41-979c-21e81c2ac6f1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:38.415120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:38.416014 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.416305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.416587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.429139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:38.430616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:38.448082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:38.449413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:38.450696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 321/614] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:38.457028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:38.567725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187a60-80be-4713-9186-77a83483dbe4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:38.614727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:38.615330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.615618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.615947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.616812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:38.617126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:38.618572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430d44-0d91-4c2d-a486-17e82a168c7b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:38.644472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 294/615] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 18:25:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:38.644933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:38.655068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae14816-0ae6-4bf1-a300-04e9af3f6e7e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.655363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae14816-0ae6-4bf1-a300-04e9af3f6e7e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.655650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae14816-0ae6-4bf1-a300-04e9af3f6e7e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.657051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 295/616] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:38.666419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.666833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.667122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.697057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:38.698289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:38.709552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:38.809286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632fb42-a846-481a-a86b-d9950cda68e9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:38.847461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 296/617] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:38.869629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:38.872500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:38.883780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:38.884749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:38.885051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:38.885332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:38.913555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:38.917539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:38.961659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:38.962607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:38.963470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:38.963470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:38.963470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:38.963470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:38.965876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 322/618] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:38.971381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.014563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d44b5-e28e-4b54-a8c6-906acbc354f1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.056177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ac414-7fff-425f-b809-5ef41655783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.056980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ac414-7fff-425f-b809-5ef41655783d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.057267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ac414-7fff-425f-b809-5ef41655783d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.057605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ac414-7fff-425f-b809-5ef41655783d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.077279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ac414-7fff-425f-b809-5ef41655783d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-bb5ac414-7fff-425f-b809-5ef41655783d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:39.085853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:39.086764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:39.087732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 297/619] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:39.088936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb355-ae69-4049-8fff-c5a985790cb6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.091858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb355-ae69-4049-8fff-c5a985790cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.091858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb355-ae69-4049-8fff-c5a985790cb6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.091858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 298/620] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:39.095626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb355-ae69-4049-8fff-c5a985790cb6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.099968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.139374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd0b5e-f347-45bc-8d3f-626b750beb8d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.178126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.178791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.179076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.179360 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.180137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:39.180452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.181837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bcf2b-c622-4340-ad4d-dc39359fe6ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.196117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 323/621] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:39.197559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.197853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.198134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.211151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb355-ae69-4049-8fff-c5a985790cb6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.216611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:39.217799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:39.248339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.249045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.249332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.249612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.250467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:39.250848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.252436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.258870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.263456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 299/622] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:39.264545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.303861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 324/623] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:39.303861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.363707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.404869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624332fa-141d-4712-ab72-f7eea055705f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.410954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444853a-7b80-47c0-a284-74bf2134fc7d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.447163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.450723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.450723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.450723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.451533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.451533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.451533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.451533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.457274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.459548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.463163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.464646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:39.478083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:39.479003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:39.480072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 300/624] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:39.481669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:39.482988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:39.484068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:39.485240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:39.485240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:39.485240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:39.485240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:39.488045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 325/625] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:39.490546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.518418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.602045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b10de-9bf5-4e58-b142-4ec93f9b1028 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.607495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311c0d0-5003-441e-978d-855b79318a48 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.640215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.645022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.645941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.646455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.646848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.647686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:39.648201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.649835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.650199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.651165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.651711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.652160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.664324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:39.667416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 326/626] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:39.668482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:39.675436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:39.676700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:39.677768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:39.685050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 301/627] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:39.686508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.766167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.786004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409e3d7-480a-45de-89c4-ceced77dbe44 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.799441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9c11-721f-4235-9f75-17f00c3dcc45 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.822859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.823790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.824270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.824800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.826018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:39.826438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.828427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.838127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:39.839221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:39.839657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:39.840150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:39.845133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 327/628] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:39.846175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.849004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:39.851012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:39.870075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:39.871269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 18:25:39.872465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:39.874861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 302/629] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:39.875764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:39.931175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:39.971153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac543b-b1d3-4b52-9f7d-cc72c5a65cce None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:39.991693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe1d5e-42d7-4564-8278-0a7a2e8f06e5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.009670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.010336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.010619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.010895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.011636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:40.011971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.013336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.026511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 328/630] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:40.026511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.029782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed417ad7-7c01-48d0-8ec4-49b06ff970f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.030752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417ad7-7c01-48d0-8ec4-49b06ff970f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.031045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417ad7-7c01-48d0-8ec4-49b06ff970f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.031326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed417ad7-7c01-48d0-8ec4-49b06ff970f4 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/a82d117152a54ebcbd6cf9291bef3f97/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.037747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.046546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed417ad7-7c01-48d0-8ec4-49b06ff970f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=a82d117152a54ebcbd6cf9291bef3f97, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.048062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed417ad7-7c01-48d0-8ec4-49b06ff970f4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.062808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 303/631] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:39 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/a82d117152a54ebcbd6cf9291bef3f97/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:40.064407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131151c1-d43d-41cc-bdb9-ef2b1b7f4964 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.064695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131151c1-d43d-41cc-bdb9-ef2b1b7f4964 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.065309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131151c1-d43d-41cc-bdb9-ef2b1b7f4964 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.066779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 304/632] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:40.067649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131151c1-d43d-41cc-bdb9-ef2b1b7f4964 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.163653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658746-4cc1-44d8-b688-44fce7ed41fd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.193524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.202902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.203313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131151c1-d43d-41cc-bdb9-ef2b1b7f4964 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.204288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.204774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.205323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.207091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:40.208821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.210516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8667-eeca-4056-b511-9f1ee5d4a86c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.231055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 329/633] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:40.232845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.233326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.233813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.246954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.247978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.248460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.248739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.252571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:40.254040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:40.261771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.263233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:40.283145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:40.284677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:40.285906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:40.285906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:40.285906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:40.285906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:40.285906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 305/634] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:40.286182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.356845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 330/635] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:40.362581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.364377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.412201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3147c-b11e-4e6f-b94a-6e3be6a9b768 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.449521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.450395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.450930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.451497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.472146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.501559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109854-2ebe-4d0d-86b6-46bee380148e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.540595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.541265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.541555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.541941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.542746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:40.543013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.544521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.547416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.549126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.556840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 331/636] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:40.557695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.631706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.672862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 306/637] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:40.673725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.696356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69221ed-25ae-4082-bd69-54f2b87693a4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.725718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.734265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c405052-2186-4c08-b6c6-f360ec5ae8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.735401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405052-2186-4c08-b6c6-f360ec5ae8ef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.735871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405052-2186-4c08-b6c6-f360ec5ae8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.736316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405052-2186-4c08-b6c6-f360ec5ae8ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.747059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c405052-2186-4c08-b6c6-f360ec5ae8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3c405052-2186-4c08-b6c6-f360ec5ae8ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:40.754964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:40.755986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:40.756885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 332/638] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:40.758434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780df9-a283-410a-b8eb-f5ab884e66d4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.758434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780df9-a283-410a-b8eb-f5ab884e66d4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.758719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780df9-a283-410a-b8eb-f5ab884e66d4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.764525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 333/639] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:40.765319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780df9-a283-410a-b8eb-f5ab884e66d4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.787369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01f94c-6bf5-4617-882a-ab07e4065c14 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.827356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.828239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.828458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.828739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.836680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.838179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:40.853199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:40.854208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:40.855146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 307/640] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:40.856442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:40.886610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780df9-a283-410a-b8eb-f5ab884e66d4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.902737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.924141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:40.925495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.925882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.926160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.936286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:40.937738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e9411595-c3ed-40ad-8663-442c2d26edd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:40.956594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:40.957577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:40.958493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:40.958493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:40.958493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:40.958493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:40.962518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 334/641] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:40.963548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:40.963860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:40.964145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:40.972375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41411b6-3d7d-4cfe-a748-f7e8f537681a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:40.982044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:40.982974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:40.984523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:41.013595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.014409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.014803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.015213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.016111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:41.016529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.018008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.030416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 308/642] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:41.030416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.067856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 335/643] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:41.067856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.144602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7800cba-f369-4d3a-8f9b-56d32fc6ae16 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.168875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.176135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5295d-b28f-4e79-ab1d-a067e914362a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.182234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.183208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.183705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.184227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.185102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:41.185418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.186871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.207192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 309/644] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:41.207907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.220327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.221011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.221330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.221812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.222582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:41.222905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.224403 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.241972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 336/645] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:41.241972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.243653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.321770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aca06-dedc-4013-8edc-8d8b7143976c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.354442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374c98-2bb3-4cf5-8744-bce65a7bdf5f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.359480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.360525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.361029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.361493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.372077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.373745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.389369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.390166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.390454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.390731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:41.394342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:41.395219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:41.396308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:41.396308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:41.396308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:41.396308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:41.398213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 310/646] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:41.399030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.406266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:41.416381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:41.417344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:41.418333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 337/647] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:41.419584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.438872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.497368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.519922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4064-aadd-410f-b578-6d44e87cffa5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.526145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06685b-9287-4010-8bfa-a08ad6af8cff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.556620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.557502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.557781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.558056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.560720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.562272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.562563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.562842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.571528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.573054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:41.587808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:41.588762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:41.589699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 338/648] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:41.590227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.636824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.638355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.688090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.716214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5fccc-d93b-4815-a383-184a33b7c001 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.724174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.755032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.760472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 311/649] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:41.760625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.760625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.760625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.760852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.760936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:41.760936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.760936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.774548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 339/650] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:41.775412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.868703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef894-92c9-434e-b39e-4cf883de553c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.883056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46507-f2d1-4960-898d-09d5b39b0b0c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:41.904797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.905737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.906030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.906307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.907541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:41.907889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.910336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.918692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:41.919352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:41.919638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:41.919945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:41.920764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:41.921084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:41.922524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:41.925156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 312/651] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:41.925865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.926787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:41.937688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 340/652] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:41.938332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:41.979895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.044956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1526-7eca-4c03-96b9-b39bd1380f17 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.060274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396c8de-ea0e-4fcf-9aa3-00e43b7dee3c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.080040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.081184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.081474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.081758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.092753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.094199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.100984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.100984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.100984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.100984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.109426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.110992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:42.119701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:42.120782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:42.121751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:42.121751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:42.121751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:42.121751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:42.124149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 313/653] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:42.125198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:42.126163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:42.127294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 18:25:42.128448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:42.131874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 341/654] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:42.133256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.190750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.224951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.232780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f59e30-e52d-4954-9eae-9f2585378a20 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.234978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508132-c593-4ea2-b3fc-dafdf4292f3b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.266336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.267125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.267409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.267683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.269582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.270243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.270535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.270813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.271653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=c8d6c2d367804ad5b3802d487efb13ed) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:42.272006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.273455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.278017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.279239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 342/655] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/role_assignments?user.id=c8d6c2d367804ad5b3802d487efb13ed&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:42.279799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.280046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:42.297990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:42.298954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:42.300424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:42.300424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:42.300424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:42.300424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:42.300650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 314/656] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:42.301683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.417293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881416-4a99-47d3-bc4c-ff9a117d5cda None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.419551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075df95-4be1-4560-b8ef-e6495bdc67e1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.443625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.456708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.457712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.458002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.458278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.459136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:42.459450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.460586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.460934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.461891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.461891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.461891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.463362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:42.463362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.464235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d210-9168-4506-b928-dffa5d9074f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.477723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 343/657] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:42.479062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a6e1e-085b-4ca3-9fe2-8a6bbf27b775 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.479355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a6e1e-085b-4ca3-9fe2-8a6bbf27b775 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.479638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a6e1e-085b-4ca3-9fe2-8a6bbf27b775 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.480958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 344/658] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:42.481652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a6e1e-085b-4ca3-9fe2-8a6bbf27b775 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.489618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 315/659] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:42.490536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.494195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.592637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a6e1e-085b-4ca3-9fe2-8a6bbf27b775 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.601664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039846-eb2a-4a7c-8ea2-3a5fdbc8786c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.628734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.629400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.629694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.630168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.630701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:42.631017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.632433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b47e05-5967-4b2d-9bc5-cca44c4df5d4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.642802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.643683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.644099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.644374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.644556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 345/660] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:42.645867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.646163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.646440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.652031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.653468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.666140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:42.667358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:42.668320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:42.669211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:42.670102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 316/661] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:42.670610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.711378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.740523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.748978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 346/662] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:42.750048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.798062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb571a-bf33-497d-bb34-e3445efd64ae None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.834179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.834916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.835530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.835530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.871298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f41a4-40fa-425b-b54f-83eac526839f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:42.907703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:42.909236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:42.910077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:42.910431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:42.917329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.917754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:42.918800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.919339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:42.934699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:42.936153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 347/663] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:42.937189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:42.969709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:42.992374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.040241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 317/664] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:43.041298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.049861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96f0f-26d2-4465-b517-3c8b97f1a406 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.090144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188787e-b398-4740-92da-254af413caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.090819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188787e-b398-4740-92da-254af413caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.091102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188787e-b398-4740-92da-254af413caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.091379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188787e-b398-4740-92da-254af413caa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.092200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188787e-b398-4740-92da-254af413caa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:43.092512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188787e-b398-4740-92da-254af413caa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.093966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188787e-b398-4740-92da-254af413caa2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.106960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 348/665] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:43.112930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188787e-b398-4740-92da-254af413caa2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.151514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afb1dc-a27e-43c6-851b-fccc5aeb930b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.186554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.187475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.187925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.188296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.199617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:43.204683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:43.210043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:43.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 318/666] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:43.212414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.222504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188787e-b398-4740-92da-254af413caa2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.240856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.258107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.258801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.259086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.259366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.260231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:43.260545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.261995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.282867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 349/667] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:43.282867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.326548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192f02-e5d2-42b4-bf3c-db114ad89ba5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.360809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.361693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.362155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.363175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.375117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.376596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.391633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd830fd-93b1-4d42-87ba-aeeb155274fa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:43.394608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:43.395489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:43.396441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:43.396441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:43.396441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:43.396441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:43.396441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 319/668] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:43.396727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.435148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.435719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.436069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.436348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.437177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=fd8232022633460fbaa7479477d4014d) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:43.437812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.438914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.445344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 350/669] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/role_assignments?user.id=fd8232022633460fbaa7479477d4014d&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:43.446141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.473410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.497022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.537739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa41ed-20a1-4ac1-84e4-2687005ae417 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.589645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffaba3-333e-41b0-8dbe-ae32e4d0166e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.597267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.598008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.598297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.598572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.599348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:43.600366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.601792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.613704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 320/670] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:43.618255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.639474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.640186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.643675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.643675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.726805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.728500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.730279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148fbb-68f4-405d-a4ca-2bcf98cfbe37 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.744104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.786677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.788130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.788518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.789131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.790218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:43.790653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.792742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.810386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:43.820195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 321/671] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:43.821221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.844475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 351/672] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:43.845336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:43.934979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243dd98-21b6-41d8-ad70-e94f94b5534b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.970798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:43.971704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:43.972123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:43.972406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:43.975822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a26f9-9f42-4bc2-91e4-1e42b50f1a8c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:43.984531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:43.986585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:43.992449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:44.013616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:44.015367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:44.017745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:44.017745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:44.017745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:44.017745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:44.018918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.018918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.018918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.018918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.022142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 322/673] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:44.022142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.032129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.035420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:44.059418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:44.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:44.063678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 352/674] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:44.067621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.089190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.151397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec390cb-8203-4c59-8d7b-96f4ad262e6c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.198041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.198716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753b5bb-35dd-4e3b-ac36-9ee9041868dc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.199449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.199962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.200544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.214084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.216574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.237233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.237880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.238225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.238586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.239395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:44.239777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:44.240972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:44.242098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:44.242984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:44.242984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:44.242984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:44.242984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:44.243211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.250539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 323/675] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:44.251724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.256218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 353/676] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:44.257812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.295904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.369080 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe851-de39-47dd-a39c-e8ea171982bb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.387297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f32e6-d800-4083-99de-80fbaa0522db None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.389345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.410695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.411737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.412211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.412629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.413507 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:44.413968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.415609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.432656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 354/677] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:44.432821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.437585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.438266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.438558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.438836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.439648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:44.440531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.441997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.458454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 324/678] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:44.459331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.534423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.544513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9d11-87c5-4d9a-999f-508ea04a9a02 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.566450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074caf2c-baa3-4a00-9de4-ed270c9f8cff None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.581367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.582324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.582611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.582912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.591335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.593045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.600476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.601265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.601546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.601825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:44.607229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:44.608198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:44.609123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 355/679] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:44.610309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.614438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.615963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7787bf64-c3d8-4fe0-8eed-6394cceb1320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:44.631088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:44.632062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 325/680] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68e26e-e315-4d18-9a7b-8a88ffefb17e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.638178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68e26e-e315-4d18-9a7b-8a88ffefb17e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.638790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68e26e-e315-4d18-9a7b-8a88ffefb17e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.638790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 326/681] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:44.638790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68e26e-e315-4d18-9a7b-8a88ffefb17e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.662057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.723982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2d4be-7f9a-49c6-b03e-e378b5bc219b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.745570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68e26e-e315-4d18-9a7b-8a88ffefb17e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:44.764531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.765207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.765487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.767869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.767869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=0a7d067e3f3c4f778ec5eedccc202fc7) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:44.767869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.768968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e2ae-fa8c-4c8d-b7da-5a68240bca3f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.775661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 356/682] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/role_assignments?user.id=0a7d067e3f3c4f778ec5eedccc202fc7&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:44.777022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.777312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.777592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.802662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:44.803819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:44.804753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:44.805644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:44.806250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:44.806599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:44.807642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:44.807982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:44.809481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:44.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.836249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 327/683] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:44.837515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.888746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 357/684] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:44.889249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:44.951089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:44.983421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc85a-538a-4990-93dd-08796832d846 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.011219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25614cf1-00be-4b5c-940e-ca71deebae58 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.031109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.031771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.032123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.032400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.033184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:45.033498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.035624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.048720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 328/685] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:45.053620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.061910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.062879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.063375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.064598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.082010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:45.138450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.140308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.179304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e037b12-666d-4f77-9f5e-27c32faf17fb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.215477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.216657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.217097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.217371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.227645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:45.229643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.231090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:45.250869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:45.252297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:45.253491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:45.253491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:45.253491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:45.253491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:45.256937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 329/686] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:45.258102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.273517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 358/687] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:45.273517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.360495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:45.368788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895831a-d1cc-4e88-843f-7b0e92a82679 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.402611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0eb3a-5f25-4f1c-ae06-a97d2d141ed6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.412346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.413155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.413875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.413875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.414900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=01bb9cc9e4c34504ac6574c28963b4d6) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:45.415343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.417000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.423939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 330/688] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/role_assignments?user.id=01bb9cc9e4c34504ac6574c28963b4d6&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:45.425890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.441672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.442342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.442625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.442898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.443626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:45.443975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.445355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.459066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 359/689] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:45.465794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.536943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:45.634514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c21e0-2938-45a7-9eb2-41ccf0f548ca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.663713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2e98-1eb8-4d5e-96d9-a6880fde512b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.671683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:45.680562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.681491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.681877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.682417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.698959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.701322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.709809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871907a1-0b34-4edb-a277-82fffc3ef3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.710833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871907a1-0b34-4edb-a277-82fffc3ef3dc None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.711264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871907a1-0b34-4edb-a277-82fffc3ef3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.711724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871907a1-0b34-4edb-a277-82fffc3ef3dc None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.712661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871907a1-0b34-4edb-a277-82fffc3ef3dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.714353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871907a1-0b34-4edb-a277-82fffc3ef3dc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:45.721002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:45.722762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:45.723881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:45.723881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:45.723881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:45.723881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:45.727970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 331/690] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:45.730356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.755409 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 360/691] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:25:45 2022] POST /identity/v3/users => generated 254 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:25:45.757040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c041-ccd6-402f-917c-e2773608dafe None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.757813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c041-ccd6-402f-917c-e2773608dafe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.758093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c041-ccd6-402f-917c-e2773608dafe None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.760548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 361/692] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:45.767374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.768248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.768635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.804972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:45.807191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:45.866282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668cb70-dd1c-4338-b336-033dab78e102 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:45.876329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:45.907947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 362/693] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:45.923712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:45.924490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:45.925059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:45.925343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:45.926106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:45.926420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:45.927946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:45.930269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:45.957442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 332/694] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:45.968974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.044318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:46.056128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db4b9-efcf-4e48-a290-afe4fb5d8d76 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.079219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef889fb-3e0d-40a5-b91c-a5962d814e84 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.096366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.097846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.098687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.099204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.115676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:46.120457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.121360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.121816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.122230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:46.125536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:46.126635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:46.128067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:46.130174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 363/695] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:46.138117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.139659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.141405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:46.159786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:46.160982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:46.162054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:46.164335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 333/696] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:46.174082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.204326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:46.271303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424ae0-333c-4d26-9f4c-693c53e9fe24 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.285603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2497ea-215d-4ec7-8df1-27fe91a56ae4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.317799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.319163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.319612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.320133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.321248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:46.321710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.322197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.322953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.323336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.323709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.323927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.324721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:46.325134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.326677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.335221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 364/697] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:46.340878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.344774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 334/698] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:46.351258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.360641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:46.462524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5b1ec-9e11-4f2a-9739-9269b1e4e3e0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.464512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:46.478905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146636a-4b25-4dc4-9484-6e2c700ec8ac None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.513724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.515103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.515301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.515791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.515985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.516242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.516522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.516856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.517367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=a82d117152a54ebcbd6cf9291bef3f97) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:46.517685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.519457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.526318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 335/699] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/role_assignments?user.id=a82d117152a54ebcbd6cf9291bef3f97&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:46.530711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.532515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:46.553610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:46.554576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:46.555482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:46.555482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:46.555482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:46.555482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:46.557973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 365/700] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:46.563913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.678537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80346d99-a30e-459d-9bf3-aec4547962c6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.716714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.717716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.718212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.718683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.719635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:46.720168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.722510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.735615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 336/701] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:46.741710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.814614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:46.851810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fffb-900e-420d-9aa5-c308114ff90e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:46.886581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:46.887879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:46.888368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:46.888840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:46.897464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:46.899210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:46.914199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:46.915165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:46.916238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:46.918809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 366/702] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:46.925106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:46.940975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:47.036924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7292-8df8-4bdb-b9f6-f2b42685c026 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:47.073954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:47.074987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.075475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.075971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.077121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:47.077631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:47.079253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7961c6c-66df-4bac-b242-bee4a33c4e6e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:47.098249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 337/703] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:25:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:47.104018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:47.209289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a2eba-806c-43dc-a9a4-f7b400fabbf6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:47.235649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:47.245281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:47.246038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.246324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.246662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.319498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:47.320923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:47.321461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cc0a4-ce3c-45a5-a632-eae501ddf1d9 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.321828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cc0a4-ce3c-45a5-a632-eae501ddf1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.322028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cc0a4-ce3c-45a5-a632-eae501ddf1d9 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.323877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 338/704] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:47.331482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.331953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.332389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.359039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:47.360273 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:47.500016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:47.510921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 339/705] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:47.514783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 367/706] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 18:25:47.520804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:47.553454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:47.594170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:47.680473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7781-0940-480f-a94b-927c537000c5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:47.720092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:47.721595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.722139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.722882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] PATH_INFO: `/v3/services/network` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.723746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:47.725363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:47.741544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751d9d-1e61-40dd-9bd0-60e7f0ce4751 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:47.746218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:47.747221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:47.748271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:47.751416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 368/707] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:47 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:47.759948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:47.881662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:47.882444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.887855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.887855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.904351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:47.916677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b521-896a-43d6-9424-7a30a681168c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:47.919996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:47.921496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:47.959928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:47.960792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.961939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.962242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.962967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:47.963279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:47.964678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4400-244c-4ebd-84dc-c8a9500e8836 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:47.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:47.970384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:47.972101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:47.972101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:47.972101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:47.972101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:47.972356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 369/708] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:25:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:47.972356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c480-e41c-485d-973d-de2eb6e5b457 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:47.972356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c480-e41c-485d-973d-de2eb6e5b457 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:47.974845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 340/709] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:47.976046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c480-e41c-485d-973d-de2eb6e5b457 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:47.979862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 370/710] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:47.979862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c480-e41c-485d-973d-de2eb6e5b457 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:47.980042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.109838 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:48.122913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c480-e41c-485d-973d-de2eb6e5b457 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:48.163942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:48.163942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.163942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.163942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.164323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:48.164323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:48.167861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159d886-9961-4e91-b3dd-7bc1eb5c2ad5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:48.189218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 371/711] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:48.189685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.190564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.191001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.213127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:48.214323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:48.215439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e68c7-9e69-451b-8cc6-11f30aea13c1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:48.252247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:48.284899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:48.286149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.287363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.288776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.290226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] RBAC: Adding query filter params (type=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:48.290711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:48.292650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:48.304991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 341/712] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:25:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:48.305352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.399861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 372/713] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:48.456164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.520061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81c98-6cdd-436b-8252-e717a850cb7f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:48.539127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:48.558790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:48.559582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.560924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.560924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.568665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:48.570135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9ca65139-d0fa-441c-bf79-2574f81025d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:48.586459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:48.587442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:48.588376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 342/714] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:48.589336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712f91-ec89-43f3-b85d-d17d2bf818f6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.589542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712f91-ec89-43f3-b85d-d17d2bf818f6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.589818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712f91-ec89-43f3-b85d-d17d2bf818f6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.591252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 343/715] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:48.597615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.598223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.598698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.606284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff78bb-859e-490b-84a5-89d80525ae5a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:48.617189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:48.618739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:48.643826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:48.644685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.644972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.645252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.645912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:48.647370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:48.660868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:48.661923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:48.662796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 373/716] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jun 22 18:25:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:48.663672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.676404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:48.700315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 344/717] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:48.701425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.814523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573284-c398-43e7-8520-8678e99d73b0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:48.815539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c227b-1053-486b-ba85-e8bb4ea59d1c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:48.823793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:48.852976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:48.853932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.854417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.854877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.855769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:48.856288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:48.858190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:48.860092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:48.861180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:48.861672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:48.862451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:48.863414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:48.863801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:48.864496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 345/718] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 18:25:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:48.865498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.865820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:48.883617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 374/719] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:48.884702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:48.964414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:48.990864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d7fb8-bc7c-4222-8beb-cde4772584ef None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.011126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e45e99-6965-4dd9-9056-8f577c8721a8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.032272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.033241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.033803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.034977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.048989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:49.053065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.053993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.054486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.054960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.055897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:49.056404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:49.057865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:49.058757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:49.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:49.060895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:49.063907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 346/720] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:49.066837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:49.070250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 375/721] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 18:25:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:49.071138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:49.109302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:49.184457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd7959-39a2-45f3-8371-868e7bb316b2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.191884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5659-39ac-491a-ad2f-003ee44af06d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.217566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:49.232451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.233542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.234039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.234546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.235555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:49.236135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:49.239781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:49.256377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 376/722] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:49.269097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:49.272377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.273180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.273567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.273947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.274958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=fd8232022633460fbaa7479477d4014d) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:49.275372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:49.277502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:49.287968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 347/723] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:49 2022] GET /identity/v3/role_assignments?user.id=fd8232022633460fbaa7479477d4014d&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:49.427151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2172f-2a11-4ae7-a7f9-67c22f1b5e22 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.467728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.468987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.469577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.470064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.482678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:49.484498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-968fc2aa-8efc-40e2-b82b-4fefa3a9a7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:49.503612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:49.504679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:49.505582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:49.505582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:49.505582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:49.505582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:49.508209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 377/724] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:49.515892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:49.522515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbe63c-7afe-4222-8301-c6060256d1d4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.522807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbe63c-7afe-4222-8301-c6060256d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.523087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbe63c-7afe-4222-8301-c6060256d1d4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.524907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 378/725] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:49.529885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.530169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.530445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.566410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:49.569979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:49.650492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:49.707968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 379/726] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 18:25:49.713050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:49.719953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566c42-bf06-4331-8dc9-dcdbb0604317 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.742845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:49.773971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.774640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.774923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.775195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.784503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:49.784503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:49.784503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:49.790072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 348/727] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:49.803767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:49.930023 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9e91-d050-4884-b862-ad9a4c788f60 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.945933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ef19a-fb54-4da1-aea8-daf2edfcc9a1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:49.973099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:49.973924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:49.974208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:49.974487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:49.992593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:49.994052 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:50.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:50.019521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:25:50.020505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:50.023872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 349/728] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:25:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:50.025097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:50.029113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.029926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.030211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.030489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.041863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:50.054238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:50.061970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:50.064153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:50.066173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 380/729] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:50.072967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:50.137051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:50.189215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9d12-081f-4f11-88b9-e888a56b26c2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:50.251676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d94b0-ff66-41c1-b75c-9df106b7c222 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:50.254153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.254879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.255169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.255449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.256325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:50.256643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:50.258352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.296017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 350/730] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:50.297738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:50.329580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.330313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.330664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.331122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.331906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:50.332225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:50.333616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.355474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 381/731] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:50.360605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:50.442522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:50.484784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbafaf-a134-4884-b31c-42824333d117 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:50.531203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8575cd-b18f-4b08-becd-f7aef123627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.531886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8575cd-b18f-4b08-becd-f7aef123627f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.532173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8575cd-b18f-4b08-becd-f7aef123627f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.532448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8575cd-b18f-4b08-becd-f7aef123627f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.565819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:50.574025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2283397-2e9b-4633-83f1-2226447f9e99 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:50.630556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8575cd-b18f-4b08-becd-f7aef123627f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:50.632041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8575cd-b18f-4b08-becd-f7aef123627f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.644724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.645530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.645820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.646101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.670291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:50.671772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:50.695770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:50.697803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:50.699914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:50.699914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:50.699914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:50.699914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:50.699914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 382/732] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:50.708963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:50.711966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:50.759314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 351/733] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:25:50.761415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3575-8e9c-443f-9fd5-56f58c4f03c9 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.761902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3575-8e9c-443f-9fd5-56f58c4f03c9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.762374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3575-8e9c-443f-9fd5-56f58c4f03c9 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.768993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 352/734] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:50.772046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3575-8e9c-443f-9fd5-56f58c4f03c9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:50.849206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ea40b-65df-4daf-b9cb-7bc4ac1694ae None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:50.888934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.889961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.890976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.891459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.892780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:50.893636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:50.895900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334527-7014-4c38-825c-3aadd88d7b28 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.903549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3575-8e9c-443f-9fd5-56f58c4f03c9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:50.916920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 383/735] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:50.916920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.916920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.916920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.940299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:50.942531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:50.946220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:50.947437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:50.947885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:50.948172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:50.948453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:50.961439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:50.963077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:50.982901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:50.984032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:50.984941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:50.984941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:50.984941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:50.984941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:50.987923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 353/736] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:50.988944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.022788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.027690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 384/737] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:51.029835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.114750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a294d5-a5a6-444f-8687-dc97a55890f9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.162230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.163116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.163468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.163817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.165351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac02f3-d2fa-4820-b9cf-ff56c32dab98 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.172010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.173689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:51.190743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:51.191767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:51.192760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:51.196960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 354/738] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:51.197798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.209050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.210467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.210962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.211415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.212897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:51.213485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.215332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.227796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.235915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 385/739] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:51.237545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.301133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.320482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8939-2a05-4cda-8e06-e8eedb415999 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.363004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.364598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.365186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.365737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.366641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.367472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08ae3-9eb1-4434-b296-610fa1c7ef6e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.368439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.389574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 355/740] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:25:51 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:51.390965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.444449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.445157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.445511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.445864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.446844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:51.447278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.448836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.488676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 386/741] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:51.494363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.529627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de6a3b-10d0-41c0-b2a2-cc4428078dad None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.563698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.576948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.577763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.578050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.578385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.587347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.588860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2a1a5de6-2873-4c1b-840c-77c14fab6cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:51.605490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:51.606646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:51.607699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:51.611187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 356/742] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:51.612899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07a58-2b88-4d1c-9878-c4b2817b1e7c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.613190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07a58-2b88-4d1c-9878-c4b2817b1e7c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.613473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07a58-2b88-4d1c-9878-c4b2817b1e7c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.614774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 357/743] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:51.615825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b50e1-30c9-41e8-8b68-e4d2367b1647 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.616180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b50e1-30c9-41e8-8b68-e4d2367b1647 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.616515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b50e1-30c9-41e8-8b68-e4d2367b1647 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.617709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 358/744] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:51.618392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b50e1-30c9-41e8-8b68-e4d2367b1647 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.622255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.622895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1729-7d21-4f0b-b9d9-bfc33ccdccbd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.665728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9062-f84b-47c7-ad45-204b0ddab06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.666405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9062-f84b-47c7-ad45-204b0ddab06b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.666687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9062-f84b-47c7-ad45-204b0ddab06b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.666959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9062-f84b-47c7-ad45-204b0ddab06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.730192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b50e1-30c9-41e8-8b68-e4d2367b1647 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:51.738639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e9062-f84b-47c7-ad45-204b0ddab06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.740274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e9062-f84b-47c7-ad45-204b0ddab06b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.769459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:51.769459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.769459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.769459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.770177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:51.770177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:51.771442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13555-aa4a-4c4d-9e9b-5ef3f2f649ca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:51.789225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 359/745] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:51.789225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.789225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.789225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.806083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.806381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:51.807608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:51.859665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 387/746] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 18:25:51.861253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:51.861831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:51.862352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:51.875298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:51.880309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:51.881656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:51.891890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 360/747] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:51.891890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:51.979861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 388/748] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 18:25:51.979861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.014605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741ad37-89d9-4e1b-8023-586b5f0e1026 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.053067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.053732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.054020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.054294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.055130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=52b394e0a6464e1592af1956cabc52f0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:52.055444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:52.057028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:52.062953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 361/749] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/role_assignments?user.id=52b394e0a6464e1592af1956cabc52f0&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:52.063781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.071750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:52.092335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5415c22-4d35-43e6-98a3-6b6a52a1a694 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.134206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.135121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.135468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.135816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.145703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:52.147611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:52.149216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:52.169247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:52.170194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:52.171075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:52.171075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:52.171075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:52.171075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:52.176034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 389/750] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:52.177018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.203956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081332d-59ee-4bc4-8c6a-d863958f7eb6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.251007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.251680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.252172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.252540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.253386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:52.254768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:52.274951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 362/751] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:25:52 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:52.280188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.324124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28b7d-cf50-4365-af0e-542a07bc691f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.404489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:52.411816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.413034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.413522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.413996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.427649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:52.435975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:52.437000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:52.437834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:52.441190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 390/752] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:52.447300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.518048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8f38-9a97-4bf3-b35d-d97df75d9272 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.541596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:52.578167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.578844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.579283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.579565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.580785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:52.581250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:52.583084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:52.591012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329f6c-a392-4f1f-8899-f63eb1b8b1cd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.600304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 363/753] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:52.605424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.633400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.634081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.634373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.634675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.635418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:52.635736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:52.637864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:52.650826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 391/754] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:52.661401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.806264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b210996-8f36-4490-9789-06eb7af30abb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:52.874882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:52.875686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:52.875999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:52.876434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:52.883955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:52.885853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:52.901595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:52.902537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:52.903435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 364/755] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:52.909050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:52.912265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:52.992199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:52.999858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebe272-f439-4ef0-85d3-4da2c21bb7d3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:53.038818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:53.039615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.039919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.040198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.052196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:53.053667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:53.072928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:53.073912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:53.075067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:53.075067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:53.075067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:53.075067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:53.075067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 392/756] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:53.079890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:53.126107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b207a-579c-4491-bd6b-8974b0af88f8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:53.194251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135bb6-d6b0-4739-9364-89eba4c1925c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:53.201852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:53.209550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:53.210606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.210894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.211171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.212005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:53.212322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:53.213995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:53.231947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:53.232616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.232896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.233170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.233893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:53.234202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:53.235563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:53.245380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 365/757] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:53.253764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 393/758] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:53.254560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:53.259222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:53.444157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc324-d625-42eb-9066-532a15a1e1d0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:53.480464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:53.481251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.481538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.481816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.482139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:53.489971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794b813-ef27-4d1b-a953-7508111c9502 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:53.490132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:53.491454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:53.506410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:53.507650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:53.508764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 394/759] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:53.515309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:53.551617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:53.552316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.552742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.553026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.553866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=a82d117152a54ebcbd6cf9291bef3f97) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:53.554180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:53.555611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdbf2-1044-41b9-9227-39a0e88f3b3a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:53.562424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 366/760] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:25:53 2022] GET /identity/v3/role_assignments?user.id=a82d117152a54ebcbd6cf9291bef3f97&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:53.566284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:53.680223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78797ec3-84c4-43f0-b776-d1014884d414 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:53.688361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3a7e-0a3c-4d32-8ab8-ba2261d68813 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.688986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3a7e-0a3c-4d32-8ab8-ba2261d68813 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.689503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3a7e-0a3c-4d32-8ab8-ba2261d68813 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.691499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 367/761] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:25:53.697364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.697958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.698440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.725002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:53.726213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:53.749120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:53.749809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:53.750086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:53.753297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:53.753297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:53.753297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:53.753721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:53.798194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 395/762] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:53.804451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:53.859251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 368/763] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:25:53.891711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:53.971725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:53.993077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e30f-6d34-4985-be27-e374247e50e9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.037282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.038083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.038367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.038642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.060924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.062390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.066188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa083-1872-4ba0-96af-624f4220d0e7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.080300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:54.101361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:54.102335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:54.103250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:54.103250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:54.103250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:54.103250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:54.108166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 396/764] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:54.114099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.134222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.135032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.135320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.135597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.136290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.137667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:54.157695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:54.159069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:54.159953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:54.160712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 369/765] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:53 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:54.173125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.251226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c510b0-0743-4d4d-9be5-2849ecd9af93 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.348320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e9cc-c8a2-4ac0-8d8f-5c4ed60686c1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.350535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.351271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.352553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.352918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.353757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:54.354141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.355609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1511e-5641-45a0-8f81-daa4234f38b4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.358780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:54.373117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 397/766] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:54.378584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e91fe-74de-4ad5-ab40-90c9bad7d1c7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.378584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e91fe-74de-4ad5-ab40-90c9bad7d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.378584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e91fe-74de-4ad5-ab40-90c9bad7d1c7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.381001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 398/767] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:54.381971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e91fe-74de-4ad5-ab40-90c9bad7d1c7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.397438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.398797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.399536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.400061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.401169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:54.402070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.404120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dad11-c5e7-4ffe-b2f8-0da6b28e03a0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.411127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 370/768] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:54.412743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.413277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.413771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.436212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:54.437678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:54.454372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:54.501136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e91fe-74de-4ad5-ab40-90c9bad7d1c7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.520315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 371/769] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:25:54.521333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.539453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.540633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.541120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.541590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.548973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.550689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:54.573632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:54.574609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:54.575495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:54.577989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 399/770] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:54.583856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.641632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:54.657453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfaa5-9abb-4a66-b1cf-219813a54da2 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.687587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158712-3d28-4e95-8a76-24936f936f39 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.695652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.696354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.696642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.696924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.697748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] RBAC: Adding query filter params (type=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:54.698065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.699454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.710111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 372/771] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:54.710972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.728104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:54.728571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.729657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.730134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.730569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.742297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:54.750727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:54.751645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:25:54.753034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:54.755793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 400/772] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:54.756858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.837511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb361864-ff5e-49b8-880b-0e523edbaf3a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.865003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae8c0a-25c0-4017-af12-90a2710ac07c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:54.876846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.878054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.878314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.878588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.879568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:54.879858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.881375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.886717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:54.900929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 373/773] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:54.900929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.912069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:54.913078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:54.913613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:54.914104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:54.915075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] RBAC: Adding query filter params (interface=public, service_id=eabba3a6e9ee4e1189c7d6f5c717f56b, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:54.915542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:54.916956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:54.925626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 401/774] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/endpoints?service_id=eabba3a6e9ee4e1189c7d6f5c717f56b&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:54.926413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:54.977819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:55.004379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4672-9f8e-4169-be20-ed0c49a931aa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.034452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b801-9ddb-4108-ab40-fed79f851fc7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.040502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.041553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.041848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.042122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.042866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:55.043525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.045498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1c521-d004-4f7f-ac1b-45da4bc5f6cd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.056658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 374/775] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:55.058251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc49e9-2e6d-4875-b5ed-b90277b22b9c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.058541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc49e9-2e6d-4875-b5ed-b90277b22b9c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.058817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc49e9-2e6d-4875-b5ed-b90277b22b9c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.063940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 375/776] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:55.063940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc49e9-2e6d-4875-b5ed-b90277b22b9c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.073265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.074156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.074437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.074711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/fd8232022633460fbaa7479477d4014d/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.076696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=fd8232022633460fbaa7479477d4014d, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.078124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.091770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 402/777] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:54 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/fd8232022633460fbaa7479477d4014d/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:55.092705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.145701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:55.199951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc49e9-2e6d-4875-b5ed-b90277b22b9c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.227524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002bc38-d78d-4d7e-8446-a05be8bc3abf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.241042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d966a-503f-4f49-b2df-79a7f99b526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.242038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d966a-503f-4f49-b2df-79a7f99b526b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.242537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d966a-503f-4f49-b2df-79a7f99b526b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.243027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d966a-503f-4f49-b2df-79a7f99b526b None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.243820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d966a-503f-4f49-b2df-79a7f99b526b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.245369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d966a-503f-4f49-b2df-79a7f99b526b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.247869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:55.258633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 376/778] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:55.260621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.260988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.261348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.275404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.276704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.277299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.277800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.292658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.294481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.295706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:55.297014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:55.316928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:55.317891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:55.318778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:55.318778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:55.318778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:55.318778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:55.318778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 403/779] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:55.324462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.406143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 377/780] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:25:55.437552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.453204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:55.467910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa4fc6-e3c0-4af2-8c47-fd9c621cfa73 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.513455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.513455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.513773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.514029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.514780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:55.515096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.518092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.536383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 404/781] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:55.543946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.588840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf55b-388e-4497-9130-d884b7280c41 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.623326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:55.637142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.637962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.638256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.638528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.639202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.640795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:55.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:55.665265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:55.666145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:55.667081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 378/782] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:55.679235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.722951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c294be-439b-4182-aa05-3de0958e18d6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.796472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.797272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.797560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.797838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.809265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.810810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:55.828274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:55.829458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:25:55.831452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:55.835862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 405/783] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:55.835987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.851612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:55.891566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dacf2-8def-4800-bd50-d2b97f7f96f1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.944659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95192-ce67-4462-97a3-75f18e466173 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:55.947860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.948648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.949032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.949501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.950332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:55.950737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.952764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22d52d-a825-4275-9efd-6999413e0cfd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:55.960190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 379/784] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:55.961927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a910e4-e6d4-463e-a466-33b3f24cefbe None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.962558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a910e4-e6d4-463e-a466-33b3f24cefbe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.962933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a910e4-e6d4-463e-a466-33b3f24cefbe None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.965171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 380/785] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:55.965997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a910e4-e6d4-463e-a466-33b3f24cefbe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:55.987152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:55.988058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:55.988908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:55.989305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:55.990529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:55.990945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:55.993172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811c430-599a-4e71-bee6-6e4a7a798797 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.020188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 406/786] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:56.022291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.022681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.023059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.037655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.047015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:56.049640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:56.084572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a910e4-e6d4-463e-a466-33b3f24cefbe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.124987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.140054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.140054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.140054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.140054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.140490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:56.140490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.140490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.140757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 407/787] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:25:56.141765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 381/788] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 18:25:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:56.141908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.148916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.265914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efb451-2162-40ab-9179-951a64c76c53 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.274894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe3a14-e29c-4759-801f-0f31adf96cd5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.296477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.310576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.311388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.311684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.311967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.314020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.315942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.316436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.316925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.317917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] RBAC: Adding query filter params (interface=public, service_id=8fb5933bf5904f1687c8b67d672e333a, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:56.318462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.320585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.322958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.324510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.333334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 382/789] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/endpoints?service_id=8fb5933bf5904f1687c8b67d672e333a&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:56.334418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:56.346900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:56.347827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:56.348750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:56.348750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:56.348750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:56.348750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:56.348750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 408/790] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:56.349462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.413542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.455742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb517-e8ef-4563-aecb-c975ee330252 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.469630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad06981-c0f3-4493-a51d-00fbb7305631 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.502934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.504138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.504479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.504793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.508318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.509183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.509610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.510026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.510896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.512530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.519039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 409/791] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:56.520259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.526265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:56.534513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:56.535722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:56.536783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:56.539085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 383/792] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:56.545552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.633050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.721178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baad3a-60e3-4251-b241-171714ce4137 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.736964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ade58-0b79-4e42-8416-21101c4d2c4c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.762473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.772362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.773304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.773818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.774228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.775159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:56.775620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.777323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.784156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.785003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.785209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.785488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.786218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:56.786532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.787913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.789780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 384/793] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:56.796238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.806698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 410/794] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:56.808251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:56.930163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42f005-0907-45cf-b09f-c7c0b7b37bdd None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.933983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ecf99-55b4-4435-b75d-8aabbbfbbc7b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:56.941500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:56.971742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.972991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.973482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.973989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:56.985982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:56.988250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:56.997943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:56.998742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:56.999027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:56.999306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:57.009709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:57.010626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:57.011547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:57.011547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:57.011547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:57.011547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:57.011780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:57.012455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:57.014256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 385/795] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:57.019792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:57.050733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:57.051708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:57.052639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:57.061538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 411/796] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:57.077192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.121393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:57.201086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4582-d895-4ba7-8eb2-2b2b38e5c0f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:57.241677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:57.242746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.243274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.243767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.244945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:57.245733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:57.247721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:57.275870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67303-2217-428c-88e5-46e94a389ef9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:57.276762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 412/797] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:57.279089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.322635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:57.323301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.323584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.323878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.326710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:57.327030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:57.328433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:57.370261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 386/798] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:25:57.380864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.422419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a68fa-b408-4b16-a38b-6604c75b6fb2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:57.443193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:57.448516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:57.463118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc0b57-e6f5-45d4-8394-635eaf4c6891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:57.464215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc0b57-e6f5-45d4-8394-635eaf4c6891 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.464500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc0b57-e6f5-45d4-8394-635eaf4c6891 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.464778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc0b57-e6f5-45d4-8394-635eaf4c6891 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/52b394e0a6464e1592af1956cabc52f0/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.483142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc0b57-e6f5-45d4-8394-635eaf4c6891 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=52b394e0a6464e1592af1956cabc52f0, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:57.484776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc0b57-e6f5-45d4-8394-635eaf4c6891 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:57.513873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 413/799] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:57 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/52b394e0a6464e1592af1956cabc52f0/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:25:57.515364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5952004-606b-4916-8e8c-0096467904e3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.515703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5952004-606b-4916-8e8c-0096467904e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.516067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5952004-606b-4916-8e8c-0096467904e3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.518366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 414/800] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:57.524837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.525335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.525728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.544855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:57.546238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:57.578931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5160b-a20a-4698-8fac-9c125a79ce10 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:57.632011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 415/801] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:25:57.658505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:57.659129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.659820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.660136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.660474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.675883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:57.677377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:57.703667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:57.704712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:25:57.706244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:57.712370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 387/802] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:57.720188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.753297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:57.793686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301f19-e95f-4e25-bb58-3cfb3ca183fc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:57.841575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69a372-56ff-4f54-9c0f-88d40e2d7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:57.842246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:57.843297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69a372-56ff-4f54-9c0f-88d40e2d7dcd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.843581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69a372-56ff-4f54-9c0f-88d40e2d7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.844265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69a372-56ff-4f54-9c0f-88d40e2d7dcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.859347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69a372-56ff-4f54-9c0f-88d40e2d7dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:25:57.865379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783451a-1460-43b7-a949-b8dfda169968 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ed69a372-56ff-4f54-9c0f-88d40e2d7dcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:25:57.868688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:57.869668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:25:57.870485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:57.873944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 416/803] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:57.875964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d38ab-5ecf-4e8b-889d-9835cb5f0b35 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.876464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d38ab-5ecf-4e8b-889d-9835cb5f0b35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.877844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d38ab-5ecf-4e8b-889d-9835cb5f0b35 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.879952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 417/804] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:57.881113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d38ab-5ecf-4e8b-889d-9835cb5f0b35 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:57.914419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:57.916141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.916651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.917383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.919123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:57.919664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:57.921560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2bcc-959c-441a-a1fc-2cdcb38fbd8a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:57.942091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 388/805] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 18:25:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:57.944151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:57.944682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:57.945231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:57.966550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:57.968108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:58.015370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d38ab-5ecf-4e8b-889d-9835cb5f0b35 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.057537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.058630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.063871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.064051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 389/806] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:25:58.064051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.065893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.066959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:58.067514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.073685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.077508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.091861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 418/807] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:58.097307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.148255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.194479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d46b6-45c5-4ba5-8e75-777e82cf785c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.211502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df931-6a24-418e-a1e4-75fed15ed90c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.241548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.242361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.242649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.242928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.249055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.250060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.250624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.251085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.255090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.256576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.263298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.265040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:58.278415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:58.279271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:58.280202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:58.280202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:58.280202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:58.280202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:58.284410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 390/808] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:58.285253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:58.286390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:58.287215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:58.288205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:58.288205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:58.288205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:58.288205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:58.290439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 419/809] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:58.295771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.369268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.410933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7568ff-1b56-4a96-b2c3-832492934ece None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.426931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f7723-76ab-4a80-b724-28d0a3b6da02 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.432420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.448192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.449002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.449289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.449570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] PATH_INFO: `/v3/services/network` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.450238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.451614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:58.467567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:58.468640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:58.469493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 391/810] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:58.470300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.471452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.472425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.472883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.473345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.474621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:58.475220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.476913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.490976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 420/811] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:58.492103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.594358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22bd6-8075-4347-9f02-c1ecbc76a325 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.623788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ca49f-2737-4460-88a9-11e15df7ab17 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.637088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.638697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.639626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.640136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.640611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.641559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:58.642124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.644078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.656501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 392/812] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:58.657596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.664006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.664696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.664988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.665270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.666001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:58.666317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.667740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.673953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 421/813] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:58.674813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.709947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.767862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537caa0-db0c-4c49-8228-b6d6eee0a767 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.786270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028163-edf9-43b1-8828-b909941a7c5a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.807957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.809163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.809710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.810190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.818452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.820312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.827603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.828438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.828731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.829013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.837511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:25:58.838433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:58.839288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:25:58.840437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:58.840950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.842769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 393/814] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:58.843693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:25:58.861868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:58.863002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:25:58.864180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:58.865991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 422/815] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:25:58.867037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:58.905072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.951323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682a40-4117-4de9-af9b-6d50bc4ea728 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.954515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:58.982113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff1bb9-266d-4142-add2-eb66a10fa3fe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:58.988891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:58.989552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:58.989881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:58.990207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:58.990919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] RBAC: Adding query filter params (type=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:58.991228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:58.992623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:58.997867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 394/816] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:58.998722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.023306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.024354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.024941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.025524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.026607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:59.027147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.029105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.047466 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 423/817] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:59.049259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.102061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe47d-2aab-40dd-b98e-d881299293ff None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.137313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.138262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.138547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.138823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.140030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:25:59.140339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.141772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.156069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:59.165337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 395/818] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:25:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:25:59.165337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.168648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e8742-ef7f-4081-9dad-b0ce2ec0d2f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.191156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:59.204883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7a5dc-090e-4c3e-b2c2-d78fa19d65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.205583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7a5dc-090e-4c3e-b2c2-d78fa19d65f7 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.205880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7a5dc-090e-4c3e-b2c2-d78fa19d65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.206149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7a5dc-090e-4c3e-b2c2-d78fa19d65f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.206895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7a5dc-090e-4c3e-b2c2-d78fa19d65f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.208297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7a5dc-090e-4c3e-b2c2-d78fa19d65f7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.231884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 424/819] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:25:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:25:59.233256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb38f7-fa9f-4174-a1e4-c6fde815731e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.233554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb38f7-fa9f-4174-a1e4-c6fde815731e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.233835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb38f7-fa9f-4174-a1e4-c6fde815731e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.235294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 425/820] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:59.236769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb38f7-fa9f-4174-a1e4-c6fde815731e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.294818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020296d-7a49-4711-9b90-5f1856aaf3f3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.363125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fbf74-c651-4a63-b183-e57905b8d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.364081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fbf74-c651-4a63-b183-e57905b8d10f None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.364367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fbf74-c651-4a63-b183-e57905b8d10f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.364643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fbf74-c651-4a63-b183-e57905b8d10f None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/a82d117152a54ebcbd6cf9291bef3f97/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.366745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fbf74-c651-4a63-b183-e57905b8d10f None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=a82d117152a54ebcbd6cf9291bef3f97, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.367165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb38f7-fa9f-4174-a1e4-c6fde815731e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.368266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fbf74-c651-4a63-b183-e57905b8d10f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.395953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 396/821] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:25:59 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/a82d117152a54ebcbd6cf9291bef3f97/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:25:59.395953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.395953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.395953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.418580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:25:59.419969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:25:59.427463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.428193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.428995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.429278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.454868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:59.509658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.511265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.536083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 397/822] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:25:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:25:59.560027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.577339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:59.625895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 426/823] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:25:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:25:59.631150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.698083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3bb04-e454-4253-9bdb-acd8f27149c5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.702181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:59.734901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.735715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.736590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.736866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.737665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.739035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:59.752663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:59.753631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:25:59.754616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 398/824] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jun 22 18:25:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:59.759873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0591fa-3e95-413d-9a17-e9e74af19653 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.762383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.798422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:25:59.799759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.800079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.800357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.812617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:25:59.814146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fd45af58-4dbb-4afa-8d13-3e081c688d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:25:59.834391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:25:59.835381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:25:59.836296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:25:59.836296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:25:59.836296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:25:59.836296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:25:59.840217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 427/825] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:25:59.842037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265ab4-a681-47d5-8bfa-2119561091c6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:25:59.842330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265ab4-a681-47d5-8bfa-2119561091c6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:25:59.842609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265ab4-a681-47d5-8bfa-2119561091c6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:25:59.844197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 428/826] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:25:59.849609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265ab4-a681-47d5-8bfa-2119561091c6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:25:59.958971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265ab4-a681-47d5-8bfa-2119561091c6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:25:59.960799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:25:59.973880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.000462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2eef5-4d44-4cca-a710-cd60778751ad None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.002458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.003444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.004577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.004867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.005604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:00.005922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.007314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5d7f5-fa49-4298-b9a6-1d1015063751 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.020190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 429/827] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:00.021432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.021729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.022010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.039459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:00.040675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:00.046892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.047660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.048446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.048930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.049748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:00.050514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.052335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.061562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 399/828] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 18:25:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:00.061562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.119417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 430/829] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:00.120339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.174500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc8cff-a2d0-4610-b0ec-9d37f0a8021d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.208441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.209287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.209505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.209777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.216648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.218075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.219372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.221259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.230302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17802-92dd-40fd-b902-fb7f50937a48 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:00.237634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:00.238690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:00.239890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:00.242102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 400/830] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:00.243394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.270326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.270998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.271287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.271569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.272321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:00.272636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.274021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.283341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 431/831] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:00.283341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.356005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eed16-a2be-4954-b833-d10b7857c925 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.389200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37176d3-33d6-4e5c-8292-c70bc9a604f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.390925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.391725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.392040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.392456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.402662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:00.410655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:00.411577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:00.412451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 401/832] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:00.413135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.428026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.429150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.429504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.429790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.430603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:00.430965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.432698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.450223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 432/833] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:00.451189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.470453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.478681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.520608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4617651-ab28-4af1-a1a5-f692427949f8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.556642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.557295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.557585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.557875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.558622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.560065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.561657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c2e6f-d055-4829-9c8e-dbf7685638ce None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.581106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 402/834] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:00.589232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.611717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.612715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.613218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.613331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.614305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:00.614997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.616277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.632983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 433/835] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:00.634142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.732465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.734229 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce820e-a260-4e5e-9ee1-936b22a62f86 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.761828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:00.771164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de6280-d77a-47a6-8342-e447f83ce7b4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:00.791458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.792465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.792932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.793394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.794419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=fd8232022633460fbaa7479477d4014d) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:00.794918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.796608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.805290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 403/836] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/role_assignments?user.id=fd8232022633460fbaa7479477d4014d&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:00.818489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:00.819481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:00.819910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:00.820290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:00.834727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:00.836444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:00.855981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:00.857171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:00.858296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:00.858296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:00.858296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:00.858296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:00.860100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 434/837] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:00.866262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:00.980323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c5f00-5cf6-485e-a10b-619625da4b60 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:01.019101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:01.019893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.020189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.020474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.021205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:01.021518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:01.022885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:01.035790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 404/838] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:01.041259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:01.153404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eea06a-1467-4a4e-91fb-f05b49e1e641 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:01.180297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:01.190890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:01.191709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.192026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.192303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.201172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:01.202639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:01.217960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:01.218931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:01.219896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 435/839] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:01.225132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:01.272432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:01.344081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98090da4-926c-4a3f-9235-33fe8c64dfd0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:01.381038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:01.381702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.381977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.382254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.383346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:01.383656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:01.385114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9ed3d-5b93-433a-bcbc-9c1c93942bda None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:01.403797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 405/840] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:01.409511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:01.514096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe665b70-4cc4-4b51-a92b-17f70ed14718 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:01.548442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61088f51-0ad5-447d-ad70-7953210e0125 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.549199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61088f51-0ad5-447d-ad70-7953210e0125 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.549463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61088f51-0ad5-447d-ad70-7953210e0125 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.551086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 406/841] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:01.552334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:01.553157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.553589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.554009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.555965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.556255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.556532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.573362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:01.574635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:01.621682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:01.642672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:01.644658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:01.657084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 407/842] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:01.681260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:01.710952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:01.764821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 436/843] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:26:01.773359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:01.801854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2ba2-0ade-48da-941c-98c2cbcfbba7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:01.852155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:01.852970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.853259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.853542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.868177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:01.868675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:01.877904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:01.878852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:01.879677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:01.886811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 408/844] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:01.887815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:01.890420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb9d6-8b50-4bdb-ad30-b1f564bf23c4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:01.941697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:01.944414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:01.945444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:01.945911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:01.961841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:01.964707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:01.982743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:01.991065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:01.992516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:01.993435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:01.993435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:01.993435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:01.993435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:01.996948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 437/845] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:01.997778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.001664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9a3d-e8ab-4397-952f-d7a0c869f3e2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.042547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.043620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.044149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.044625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.045600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:02.046109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.047673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.062107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 409/846] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:02.063229 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.109343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ae21a-77a1-4805-8661-46eefe3ac02b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.147416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.148136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.148416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.148693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.149423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:02.149734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.151115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.158287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:02.165421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 438/847] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:02.167709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf7cd-4cd3-45ad-8be6-a00d6c66a6d4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.171152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.203320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.204537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.205219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.205694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.219041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.221544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:02.243436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:02.244481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:02.245556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:02.245556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:02.245556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:02.245556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:02.247766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 410/848] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:02.254510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.258539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:02.292787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce9d1-9563-4fcc-8085-155fe3afd302 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.338859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.339580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.339887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.340179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.348924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.351280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:02.370976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:02.371957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:02.373126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 439/849] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:02.380142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d4a3-6fbb-43bb-ab8e-6c04d37d443d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.380625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.424162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.424858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.425150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.425435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.426169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:02.426872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.428615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.445425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:02.446802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 411/850] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:02.447901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.493153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c31c99-bfdd-4792-ae7b-b614ed41c375 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.515563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:02.532427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.534285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.534725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.535152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.536124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:02.536660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.538401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.557087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff476-078a-4cb5-b2e4-dfd4601b0345 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.557644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 440/851] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:02.558754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.591912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.592664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.592956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.593236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.601302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.602771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:02.619066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:02.620094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:02.621037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 412/852] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:02.626316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.676862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7feb-7462-4e29-bc5b-a7132b8efd5c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.696413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:02.715527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.716610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.717077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.717622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.718672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=52b394e0a6464e1592af1956cabc52f0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:02.719172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.721938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0a975-0e0c-4305-b53c-fb64784decb9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.737261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 441/853] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/role_assignments?user.id=52b394e0a6464e1592af1956cabc52f0&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:02.737453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847df74-4792-415d-a65d-1c1a0012e071 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.760812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e22ae-e23a-4ccf-b6f9-46a142085bf8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.761098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e22ae-e23a-4ccf-b6f9-46a142085bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.761392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e22ae-e23a-4ccf-b6f9-46a142085bf8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.770515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 442/854] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:02.770515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.770515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.770515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.772561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:02.788566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.789249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.789534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.789813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:02.790794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:02.791087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:02.791206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:02.792393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:02.792595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:02.813605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 413/855] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:02.819407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.888500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 443/856] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:02.912194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:02.945346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5878e-689c-4418-9bfb-7c2a191b17c3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:02.981228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb109-49e9-4299-80d1-7e77208b0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:02.981930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb109-49e9-4299-80d1-7e77208b0646 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:02.982161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb109-49e9-4299-80d1-7e77208b0646 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:02.982436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb109-49e9-4299-80d1-7e77208b0646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.023460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e90948-3be4-425c-b897-7f4a648a2f02 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.038866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.041868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.062545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb109-49e9-4299-80d1-7e77208b0646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.064711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb109-49e9-4299-80d1-7e77208b0646 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.066893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.068421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.068706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.068977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.069636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.071001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9d1616b7-d437-4a3f-8c6d-56952a08ed04 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:03.083595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:03.084808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:03.085763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 444/857] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:03.086655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcbce7-1fca-4fa3-a720-9d282442feb4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.086655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcbce7-1fca-4fa3-a720-9d282442feb4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.086874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcbce7-1fca-4fa3-a720-9d282442feb4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.088558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 445/858] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:03.093911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcbce7-1fca-4fa3-a720-9d282442feb4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.168507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 414/859] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:03.169713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.169997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.170274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.186378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:03.187557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:03.208644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcbce7-1fca-4fa3-a720-9d282442feb4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.245597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.246260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.246542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.246811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.247680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:03.248140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.249486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.259197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 446/860] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:03.259197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.265278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 415/861] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:03.265278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.278189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.304944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.371815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c046b-9a26-44de-ae89-78ee8abe7a3b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.376551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd474b6-8c3a-47be-af85-663d4440e860 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.409632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.410289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.410568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.410841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.411544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:03.411875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.413234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.414248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.415136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.415509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.415787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.428189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 416/862] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:03.428189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.438070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.439809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:03.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:03.462323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:03.463206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:03.463206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:03.463206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:03.463206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:03.463206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 447/863] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:03.468697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.518664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.548567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9708c-ba17-4d41-9e9e-6bb6b6cae6c2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.590064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.591180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.591662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.592113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.592908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.594410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.599750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.611312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6455a8-860e-4bbf-a2dc-602d27272f16 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:03.615770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:03.616855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:03.617687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 417/864] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:03.625608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.659917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.661411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.662226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.663125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.664427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:03.665553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.667420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.683484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 448/865] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:03.688876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.741902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cffb8-0c36-4abb-b992-ce59a77756eb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.778716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.779562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.780080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.780494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.781454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:03.781975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.784101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.789423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 418/866] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:03.794682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.798682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.810744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06193c-f247-4b01-a216-270681881c0d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.849807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.850657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.850940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.851266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.858206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.859772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:03.875064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:03.876033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:03.876988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:03.881164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 449/867] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:03.882019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:03.898382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:03.943960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd89451-9b1f-46b7-adaa-b349b19e8d3c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:03.988007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:03.988456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:03.988744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:03.989024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:03.989764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:03.990303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:03.991418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:03.993449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da29f8-c41f-4298-a51b-667be6f65979 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:04.003879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 419/868] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:04.043515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:04.044230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:04.044521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:04.044806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:04.045618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:04.045936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:04.047409 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0ca6d-e78f-468e-8a0f-11b3c0c2f2d1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:04.061869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 450/869] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:04.069078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:04.145180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:04.186088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb90b4-c710-4b0d-80ce-dd89b89c8689 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:04.222034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:04.222612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:04.222899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:04.223181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:04.224056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=a82d117152a54ebcbd6cf9291bef3f97) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:04.224377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:04.225824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d954a1e-0ad2-4dd0-be41-287924b0560b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:04.232233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 420/870] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:04 2022] GET /identity/v3/role_assignments?user.id=a82d117152a54ebcbd6cf9291bef3f97&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:04.981773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa132ba-72c9-4d31-8864-d1e318e9d426 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:04.982289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa132ba-72c9-4d31-8864-d1e318e9d426 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:04.982367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa132ba-72c9-4d31-8864-d1e318e9d426 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:04.983987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 451/871] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:04.989356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:04.989651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:04.989930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.007008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:05.008513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:05.077095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 421/872] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:05.101385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa132ba-72c9-4d31-8864-d1e318e9d426 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:05.183558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:05.217175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa132ba-72c9-4d31-8864-d1e318e9d426 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:05.252376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:05.253230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.253522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.253797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.264455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:05.272644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:05.273557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:05.274387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 452/873] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 18:26:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:05.280081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:05.340793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:05.383987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2b1d-a166-49f6-b3a9-16674899e4ca None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:05.421311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:05.421982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.422262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.422537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.424166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:05.424483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:05.425851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:05.434274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 422/874] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:26:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:05.439462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:05.547976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb83c-9215-405e-ab68-c10fbec44b75 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:05.584208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:05.592483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:05.593546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.594119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.594627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.606774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:05.608595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-855006ef-1c48-47a5-ba45-a8228e78d503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:05.626475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:05.627380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:05.628312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:05.628312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:05.628312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:05.628312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:05.630527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 453/875] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:05.636163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:05.645007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324c9a-1cea-4cf0-9cda-de66fad70d38 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.645602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324c9a-1cea-4cf0-9cda-de66fad70d38 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.646119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324c9a-1cea-4cf0-9cda-de66fad70d38 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.648032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 454/876] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:05.653291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.653867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.654334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.673979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:05.675496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:05.748266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ccc2-983f-42a8-96d4-721d91faeb2d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:05.756118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 455/877] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:05.774940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:05.776927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:05.787864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:05.788585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.788874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.789254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.790191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:05.790430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:05.791862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:05.805890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 423/878] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:05.811342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:05.889374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8971f25-1555-463e-af96-ce01b233b489 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:05.906534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:05.923739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a85d4-dc5a-4130-ab66-b0b02e5d11d4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:05.929774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:05.930705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.931318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.931823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.932815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:05.934547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:05.959568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 456/879] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:05 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:26:05.969596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:05.970600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:05.970887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:05.971301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:05.984105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:05.985584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5675dd53-6ef9-418f-9c55-7b3f07d14ef8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:06.003232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:06.004310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:06.005263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 424/880] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:26:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:06.010758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.093614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37606-803e-4eeb-8b3c-b9043d91ad50 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.094151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37606-803e-4eeb-8b3c-b9043d91ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.094151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37606-803e-4eeb-8b3c-b9043d91ad50 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.099867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 425/881] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:06.102180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.102466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.102742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.120151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:06.121476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:06.133496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130974d7-7794-471c-9e6f-e2bf796c8cfe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.159673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:06.171892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.172567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.173856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.174143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.175140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:06.175451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.177598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.195797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 457/882] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:06.200898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.205388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 426/883] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:06.228135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.233613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:06.311369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a896a-cb63-4c59-9809-ee8dbc0964f8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.356226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba420ebf-b1b8-4029-8229-570edf3ed577 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.356772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.357500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.357853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.358193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.402290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fa5c2-1aef-4f94-a0aa-06fa2e65b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.402953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa5c2-1aef-4f94-a0aa-06fa2e65b513 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.403235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa5c2-1aef-4f94-a0aa-06fa2e65b513 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.403935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa5c2-1aef-4f94-a0aa-06fa2e65b513 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.404682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fa5c2-1aef-4f94-a0aa-06fa2e65b513 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.406453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fa5c2-1aef-4f94-a0aa-06fa2e65b513 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.421676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 427/884] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:06 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:06.422876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dedcc-f2df-4fe8-90c6-29366758b446 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.423669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dedcc-f2df-4fe8-90c6-29366758b446 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.424084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dedcc-f2df-4fe8-90c6-29366758b446 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.425946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 428/885] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:06.431677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.432032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.432842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.450577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:06.451728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:06.453372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.457233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.481564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:06.512588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:06.556286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 429/886] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:06.574149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.605968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 458/887] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:06.611390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.700997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ffcd8-28d0-4c49-9482-93f32f5003c4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.726869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3584-5773-4e64-905f-11297ff58d9f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.738877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.739673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.740002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.740278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.740934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.742313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:06.755267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:06.756369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:06.757482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:06.761268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:06.761750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 430/888] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:06.763122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.766064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.766915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.767247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.767496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.778674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.780222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.784495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:06.799972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:06.801094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:06.802152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:06.802152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:06.802152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:06.802152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:06.806121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 459/889] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:06.807020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.875459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dffcc-12ac-466d-ba21-e0663a566947 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.911384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.912326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.912753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.913175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.914044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:06.914493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.915675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2495b4-76e9-4afc-9055-2b17dab4c98c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:06.916176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.926440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 431/890] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:06.927884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:06.953268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:06.953860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:06.954204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:06.954774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:06.955402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:06.955757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:06.957156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:06.969588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 460/891] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:06.975696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:07.015270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:07.029771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:07.037958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9645e-3592-4a0d-a4fc-ac6232860515 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:07.072097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:07.072998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:07.073422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:07.073864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:07.074713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:07.075272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:07.076796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:07.091987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 432/892] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:07.092564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7405b2-8268-4cc2-95a1-f2e3e2176a53 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:07.133241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:07.134070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:07.134360 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:07.134639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:07.143625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:07.145155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:07.161166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:07.162276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:07.163428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 461/893] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:07.168660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:07.289307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4d02-d0ae-4036-af00-1106705892c4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:07.325734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:07.326736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:07.327172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:07.327644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:07.328665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:07.329126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:07.330842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237fefe-ec6a-4fbf-abb9-806fa750e8ac None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:07.343644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 433/894] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:07.351188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:07.459240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ebded-84b1-479a-ae7a-62d286d7913c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:07.462132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:07.497764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:07.498666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:07.499105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:07.499533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:07.500572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] RBAC: Adding query filter params (role.id=489b909a965c4b11a83b2c5fc843f17e, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=52b394e0a6464e1592af1956cabc52f0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:07.501036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:07.502794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772d2a8-0db7-40c4-b031-a51d5d6f212c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:07.509279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 462/895] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:07 2022] GET /identity/v3/role_assignments?user.id=52b394e0a6464e1592af1956cabc52f0&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=489b909a965c4b11a83b2c5fc843f17e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:08.144712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2792-c134-439e-b230-302db931d67c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.145056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2792-c134-439e-b230-302db931d67c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.145260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2792-c134-439e-b230-302db931d67c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.146830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 434/896] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:08.152047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.152515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.152595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.169814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:08.170990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:08.239516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 463/897] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:08.263008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a2792-c134-439e-b230-302db931d67c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:08.272651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:08.368544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a2792-c134-439e-b230-302db931d67c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:08.408161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:08.408884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.409166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.409441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.410091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:08.411457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b490f905-c10a-45f5-a101-2cefecd13095 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:08.423387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:08.424411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:08.425265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 435/898] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:08.430773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:08.526872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:08.530766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f391-b038-4edd-8bd9-e2482e9df476 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:08.570794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:08.571827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.572353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.572840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.573775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:08.574308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:08.575947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:08.582021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 464/899] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:08.586104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cb8ce-c790-4857-9a47-7bff3f5519bf None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.586395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cb8ce-c790-4857-9a47-7bff3f5519bf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.586670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cb8ce-c790-4857-9a47-7bff3f5519bf None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.588330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 436/900] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:08.593248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:08.593876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.594393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.594923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.614455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:08.615641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:08.706232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:08.719854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 437/901] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:08.722892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18c002-b7b7-4066-a469-08d08fae0f7a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:08.737701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:08.781781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:08.783015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.783903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.784368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.785573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:08.786041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:08.788744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:08.800235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 465/902] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:08.800979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:08.833556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:08.890750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcbe0d-cd12-41c0-8f86-d896b349dd49 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:08.922046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7c43a-7b15-4241-8fb3-1a351bda34f2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:08.935269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:08.936579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.937168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.937651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.938516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:08.940876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:08.954531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:08.955574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:08.956521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:08.963888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:08.963888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:08.963888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:08.963888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:08.964226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] RBAC: Adding query filter params (interface=public, service_id=b2576d6dd8414ee287d14696b50b379c, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:08.964226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:08.964226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:08.964929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 438/903] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:08.966382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:08.968969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 466/904] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/endpoints?service_id=b2576d6dd8414ee287d14696b50b379c&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:08.977115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:09.042358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:09.085132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:09.087549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b782ee5-2426-4963-a90d-bcb80fc42311 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.096109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a211a-4848-4d45-8e52-65273fa186fa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.126879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.128025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.128551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.129101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.130143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:09.130660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:09.132619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:09.135008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f26407-9972-4784-82e1-0c25e2770fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.135683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f26407-9972-4784-82e1-0c25e2770fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.136002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f26407-9972-4784-82e1-0c25e2770fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.136284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f26407-9972-4784-82e1-0c25e2770fd5 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.137001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f26407-9972-4784-82e1-0c25e2770fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:09.138353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f26407-9972-4784-82e1-0c25e2770fd5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:09.144845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 439/905] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:09.146149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:09.152412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 467/906] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:26:08 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:26:09.244523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ab241-01b4-44fe-a756-5b36803fdb6e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.244720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ab241-01b4-44fe-a756-5b36803fdb6e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.245010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ab241-01b4-44fe-a756-5b36803fdb6e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.246884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 468/907] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:09.253215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.255439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.255439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.264139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c9538-6ad4-426d-8dc3-c327bcd51e1d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.273905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:09.275238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:09.293954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:09.305528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.306300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.306586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.306862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.307574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:09.307908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:09.309471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:09.316291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 440/908] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:09.323369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:09.375984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 469/909] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:09.398206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:09.453991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb540ac-052e-4402-aae3-9afa729c2709 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.498899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.499489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.499780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.500107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.500913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] RBAC: Adding query filter params (interface=public, service_id=7eb11dbcd10e413b8690e2ba7294684e, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:09.501249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:09.501358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:09.502858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:09.510266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 441/910] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:26:09 2022] GET /identity/v3/endpoints?service_id=7eb11dbcd10e413b8690e2ba7294684e&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:09.515597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:09.522850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6bfc7-ba87-4318-9195-ae4a0b97125e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.561522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0294370-d18c-482e-89c8-281fe250d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.562612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294370-d18c-482e-89c8-281fe250d2dd None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.563127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294370-d18c-482e-89c8-281fe250d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.563659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294370-d18c-482e-89c8-281fe250d2dd None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.564965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0294370-d18c-482e-89c8-281fe250d2dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:09.566552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0294370-d18c-482e-89c8-281fe250d2dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:09.576146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:09.586115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 470/911] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:09 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:26:09.630814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c3770-c54d-447f-8f86-823a44c3503a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.631137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c3770-c54d-447f-8f86-823a44c3503a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.631389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c3770-c54d-447f-8f86-823a44c3503a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.633418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 471/912] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:09.638993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.639316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.639558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.647028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8467f2f-fe31-4de5-9dae-1bc729eedbc0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.658604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:09.659977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:09.701549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.702643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.703108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.703561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.706019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:09.709189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:09.728183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 442/913] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:26:09 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:26:09.775866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 472/914] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:09.799186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:09.911721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf3ffe-0f64-4280-b495-967b0b482c34 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:09.929503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:09.949368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:09.950529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:09.951070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:09.951547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:09.963073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:09.972567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:09.973566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:09.974444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:09.977256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 443/915] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 18:26:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:09.983363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:10.068482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:10.104153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d148-bc9e-400f-b98a-71a4cd1262dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:10.141325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:10.142866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:10.143408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:10.143918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:10.144899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:10.145412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:10.146996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:10.160077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 473/916] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:26:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:10.162923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:10.270249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b9faf-8ca5-478a-b9e2-45efa394bf96 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:10.308052 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:10.309196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:10.309683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:10.310175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:10.321748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:10.323424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:10.341903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:10.342876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:10.343851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:10.343851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:10.343851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:10.343851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:10.346734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 444/917] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:10.352538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:10.459332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23029679-00f3-4436-95ad-f7c6542e33f4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:10.494293 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:10.495332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:10.495871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:10.496353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:10.497280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:10.497794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:10.499374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:10.502718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:10.513081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 474/918] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:10.519310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:10.548646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:10.621317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aea80e-3452-475b-9ca9-fea970d837c4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:10.656382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:10.658116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:10.658609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:10.659085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:10.666476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:10.668160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:10.683518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:10.684471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:10.685424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:10.687974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 445/919] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:10.697974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:10.803604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cbd27-2533-4ccf-897f-2034f05b6583 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:10.840059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:10.840734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:10.841019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:10.841296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:10.842197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:10.842511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:10.843965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:10.863019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 475/920] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 18:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:10.868778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:10.965653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:10.977746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323299bd-9c52-4572-a14a-b9869c3bdec6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.013260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.014047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.014331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.014610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.026010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.027514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:11.045289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:11.046353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:11.047618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:11.047618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:11.047618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:11.047618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:11.047618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 446/921] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:11.052561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.112184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:11.162430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671226a4-61e9-4edf-a783-46519c048d98 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.197690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.198353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.198641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.198920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.199644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:11.199985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.201363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ff9c9-4f59-4abf-86dc-978cd6a982e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.217480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 476/922] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:11.222807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.316676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20689-d443-473d-b19b-181f0b2b6594 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.317149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20689-d443-473d-b19b-181f0b2b6594 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.317543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20689-d443-473d-b19b-181f0b2b6594 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.319286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 477/923] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:11.325435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.325740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.326027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.334585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7344b9-70e5-4a69-8790-ec095e8fd68b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.343615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:11.345519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:11.377149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.378335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.378625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.378897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.388100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.389560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.393635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:11.409261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:11.410230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:11.411134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:11.412177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 447/924] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:11.420091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.436207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 478/925] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:11.455996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.514325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:11.532289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6265b-a9ea-4d16-b253-cc6f7ece67c0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.569907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.570672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.570964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.571244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.572068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:11.572384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.574094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.580165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55072a3-51a2-4d5d-9426-7bd8de83a513 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.593359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 448/926] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:11.594256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.620358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.621715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.622003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.622280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.623149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.625141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:11.640070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:11.642516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:11.643785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 479/927] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:11.650991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.668601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:11.719209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b844c-cc27-4d0f-a336-5145ff0959c0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.770155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d6ea1-0fa7-4915-91f8-089a9743cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.772977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6ea1-0fa7-4915-91f8-089a9743cc88 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.773278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6ea1-0fa7-4915-91f8-089a9743cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.773473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6ea1-0fa7-4915-91f8-089a9743cc88 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/52b394e0a6464e1592af1956cabc52f0/roles/489b909a965c4b11a83b2c5fc843f17e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.776539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33aacb-8542-46da-a247-d95e1dcf3fd7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:11.777382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d6ea1-0fa7-4915-91f8-089a9743cc88 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=52b394e0a6464e1592af1956cabc52f0, role_id=489b909a965c4b11a83b2c5fc843f17e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.780044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d6ea1-0fa7-4915-91f8-089a9743cc88 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.787532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:11.802551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 449/928] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:26:11 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/52b394e0a6464e1592af1956cabc52f0/roles/489b909a965c4b11a83b2c5fc843f17e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:26:11.804630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047927cd-19df-4bec-8c01-edf4a3bb5aae None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.805284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047927cd-19df-4bec-8c01-edf4a3bb5aae None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.806200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047927cd-19df-4bec-8c01-edf4a3bb5aae None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.808563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 450/929] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:11.818348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd927abd-096d-4a05-b671-610c7b289481 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.819098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd927abd-096d-4a05-b671-610c7b289481 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.819580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd927abd-096d-4a05-b671-610c7b289481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.822619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:11.823493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.823791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.824153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.824903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:11.825222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:11.826737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:11.836021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 480/930] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:11.840816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:11.841300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cd927abd-096d-4a05-b671-610c7b289481 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:11.842523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cd927abd-096d-4a05-b671-610c7b289481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:11.918558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 451/931] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:11.920285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a1136-4bf7-4126-b822-955130313264 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.920586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a1136-4bf7-4126-b822-955130313264 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.920865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a1136-4bf7-4126-b822-955130313264 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.923896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 452/932] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:11.928197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:11.928677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:11.929103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:11.947288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:11.948847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:11.965462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d846-6820-4f66-87fd-415c87d15b62 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.004475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.005148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.005743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.006026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.006906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:12.007473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.008363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.008878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.014359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 481/933] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 18:26:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:12.015687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.035232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 453/934] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:12.036083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.054384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.125094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ad29-6ebc-47b0-b506-19e4e9341494 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.151717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb24a02-90a6-463f-96a1-2fa070521eee None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.163120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.164087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.164376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.164659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.165328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.166708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:12.179601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:12.180679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:12.181505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 482/935] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:12.182297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.195217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.195911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.196202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.196488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.197243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.198622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.219138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 454/936] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:12.228965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.293935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.306123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.309496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ff906-3d25-4d37-b006-584192727c78 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.355774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.356915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.357349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.357789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.358606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.360200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:12.373841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:12.375060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 18:26:12.376684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:12.378567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe683b-afe6-457c-a0fe-c32374908cd1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.380175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 483/937] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:12.381971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.422511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.423673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.423673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.423967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.425309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:12.425309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.426260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.436185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 455/938] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:12.440349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.523293 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaec91a-e8bb-41b5-a73b-e0e3dbcdd4fc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.565983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.569282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.570009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab0e47-9cc7-413f-a8a4-e379871399f5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.570377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.570809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.571241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.572158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:12.572615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.574160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.580315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 484/939] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:12.585967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.614287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.615155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.615618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.615728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.616047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.617101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:12.617424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.619286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.633070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 456/940] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:12.634065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.701942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685329e-a5c9-464b-9ce2-2c60e9116212 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.738187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.739133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.739570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.740053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.740911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:12.741372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.742916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.752053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 485/941] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:12.754984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.764001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779598d-91b0-420b-b222-011e2bfd8007 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.808068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.809048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.809338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.809619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.810727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] RBAC: Adding query filter params (interface=public, service_id=206c34d4b0504fda9e4cbc9f969f8c2c, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:12.811047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.812627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.824131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 457/942] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/endpoints?service_id=206c34d4b0504fda9e4cbc9f969f8c2c&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:12.827728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:12.871713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.887192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd99d-703e-4113-9113-9737d81835ab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:12.924691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:12.926547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc270d-7d15-4940-9370-57a189bf2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:12.927699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc270d-7d15-4940-9370-57a189bf2bfe None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:12.928117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc270d-7d15-4940-9370-57a189bf2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:12.928534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc270d-7d15-4940-9370-57a189bf2bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:12.929508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc270d-7d15-4940-9370-57a189bf2bfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:12.930998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc270d-7d15-4940-9370-57a189bf2bfe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:12.958192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 486/943] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:12.972384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d9c5a-2f78-45e7-a34f-0ac5124ba237 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:13.021684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76c6f4-287b-40bd-882a-023a8bf66c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:13.022691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76c6f4-287b-40bd-882a-023a8bf66c5c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:13.023136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76c6f4-287b-40bd-882a-023a8bf66c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:13.023561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76c6f4-287b-40bd-882a-023a8bf66c5c None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:13.024452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76c6f4-287b-40bd-882a-023a8bf66c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:13.026367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76c6f4-287b-40bd-882a-023a8bf66c5c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:13.034975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 458/944] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:26:12 2022] GET /identity/v3/services => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:26:14.008893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad9c98-6982-4273-973a-57b3a34ce384 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.009619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad9c98-6982-4273-973a-57b3a34ce384 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.009619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad9c98-6982-4273-973a-57b3a34ce384 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.011147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 487/945] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:14.017251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.017856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.017856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.035133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:14.036322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:14.109752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 459/946] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:14.134415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad9c98-6982-4273-973a-57b3a34ce384 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.243595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad9c98-6982-4273-973a-57b3a34ce384 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:14.283733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:14.284589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.284873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.285203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.295582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:14.303765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:14.304808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:14.305726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 488/947] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 18:26:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:14.311917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.333112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:14.420038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c08e1-c927-44ed-ac68-2bb2eb4a408c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:14.455577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:14.456593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.457067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.457543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.458664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:14.459170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:14.460917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e1318-c9fd-4dd8-9538-e2be751b04c4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:14.470351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 460/948] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:26:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:14.476384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.480491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:14.493921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848fe8-84bb-4770-ac79-ad4fa192d8c6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.494214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848fe8-84bb-4770-ac79-ad4fa192d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.494506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848fe8-84bb-4770-ac79-ad4fa192d8c6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.496155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 461/949] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:14.500895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.501702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.501996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.519444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:14.520662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:14.596214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 462/950] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:14.599738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641a249-b0a9-473d-9601-0fde371af3cb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:14.615929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.627855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:14.639330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:14.640559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.641167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.642196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.654190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:14.655999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:14.676053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:14.677020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:14.677910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:14.677910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:14.677910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:14.677910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:14.684977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 489/951] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:14.686511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.720372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691923e7-123a-4239-953c-4dfdceacd012 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:14.754856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:14.765233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:14.765899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.766185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.766993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.768339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:14.770735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:14.770735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING keystone.server.flask.common [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 18:26:14.791027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.sql.core [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 18:26:14.791027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 18:26:14.791027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [parameters: {'id': '034b3c82879641ec999cabb94f688ad8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 18:26:14.791027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80322) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 034b3c82879641ec999cabb94f688ad8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 034b3c82879641ec999cabb94f688ad8. Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application conn.query(q) Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 18:26:14.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application result.read() Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 18:26:14.811131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application next(self.gen) Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application yield resource Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application next(self.gen) Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise self.value Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application session.commit() Jun 22 18:26:14.812148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.session.flush() Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application compat.raise_( Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 18:26:14.813034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 18:26:14.814193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application conn.query(q) Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application result.read() Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 18:26:14.814981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [parameters: {'id': '034b3c82879641ec999cabb94f688ad8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:14.815861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:14.816680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 034b3c82879641ec999cabb94f688ad8. Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:14.817597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 463/952] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jun 22 18:26:14 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:14.818194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.826594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb40fd6-ae44-475c-b55e-4f5292e832a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:14.864120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:14.865148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.865826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.866301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.867368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:14.867897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:14.869588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:14.884282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 490/953] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:14.891887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:14.893577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:14.933835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0bad4-c053-47a7-88c2-8482b6fbed3a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:14.974267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:14.975226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:14.975580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:14.975995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:14.983422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:14.985286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:15.000237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:15.002078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:15.003594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.004268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 464/954] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:15.009687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.015744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0299-e9be-4a2d-9550-ed835daf54cd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.038955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.064382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.065761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.066245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.066658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.076270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.078129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:15.095267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:15.096612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 18:26:15.098538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:15.103471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 491/955] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:26:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:15.104664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.124557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f2ec-e951-4b5e-ae91-5230c8c9f5a4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.153380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.163629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.164627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.164627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.164950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.165631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:15.165943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.167388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a3d7-9b2e-459e-8aa3-23cb8c81145f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.188011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 465/956] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:15.189862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44206797-0e0b-46ca-bd5e-a6a015fa7184 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.190364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44206797-0e0b-46ca-bd5e-a6a015fa7184 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.190952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44206797-0e0b-46ca-bd5e-a6a015fa7184 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.192546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 466/957] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:15.201142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b239-3b98-4e65-9b91-c46e50ff478f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.201460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b239-3b98-4e65-9b91-c46e50ff478f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.201707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b239-3b98-4e65-9b91-c46e50ff478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.220442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8806b239-3b98-4e65-9b91-c46e50ff478f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:15.222021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8806b239-3b98-4e65-9b91-c46e50ff478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:15.239721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017b5f-a4ba-4aa4-8cf2-cf6c17339cf2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.282694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.284601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.285189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.285677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.287331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:15.288276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.289779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e205-4de4-4bb4-9b7c-dd36b91b2a2a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.309641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 492/958] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:15.310982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d365b8-b450-4e24-ac5b-0e9607ff63e3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.311273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d365b8-b450-4e24-ac5b-0e9607ff63e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.311550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d365b8-b450-4e24-ac5b-0e9607ff63e3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.312954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 493/959] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:15.316740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d365b8-b450-4e24-ac5b-0e9607ff63e3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.324023 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 467/960] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:15.325551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.331987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.331987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.354585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:15.356078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:15.358102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.439404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d365b8-b450-4e24-ac5b-0e9607ff63e3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.440984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 468/961] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:15.441881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.487990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.488984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.489578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.489859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.494371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.550045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdb259-023d-4890-ba56-c89d25936b20 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.563200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.565396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.587689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.588516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.588802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.589079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.589769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.591137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.602750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:15.603731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:15.604861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.605807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 469/962] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:15.606705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.680949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 494/963] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:26:15.681801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.710036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11fbf8-f301-4ba1-9fe7-9a8ce5bbc78f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.722838 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.756169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.757715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.758137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.758541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.759206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.761589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:15.777072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:15.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:15.778925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.780363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 470/964] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:15.780363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.798806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469068-aad8-4fa3-b6e8-a732edd9ca46 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.835483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.836310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.836594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.837153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.837860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:15.838169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.839960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.841280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.851638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 495/965] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:15.852650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.894440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e78655-71ca-4c56-82ab-d43e40f49eab None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.931678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.932530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:15.932899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:15.933177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:15.944314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:15.945764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:15.958356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41f0a-8dc4-42a6-98c2-f762db5552b3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:15.964971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:15.965840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:15.966741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:15.966741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:15.966741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:15.966741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:15.966741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 471/966] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:15.967423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:15.996945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:15.999277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:15.999986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.000263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.000543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.001512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:16.001834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.003223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.008536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 496/967] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:16.009322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:16.072366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:16.081730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4944-6229-4eb5-920e-f4508d0b0ff6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.116661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.117167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c46e-3ee5-44cf-bf71-2c06d8f32f6c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.117353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.117615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.117891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.118611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:16.118915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.120325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.135862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 472/968] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:16.135862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:16.167422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db286003-e929-4087-8ede-21049a435e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.168330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db286003-e929-4087-8ede-21049a435e53 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.168684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db286003-e929-4087-8ede-21049a435e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.168960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db286003-e929-4087-8ede-21049a435e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.169704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db286003-e929-4087-8ede-21049a435e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:16.170019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db286003-e929-4087-8ede-21049a435e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.171548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db286003-e929-4087-8ede-21049a435e53 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.185476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 497/969] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:16.191356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db286003-e929-4087-8ede-21049a435e53 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:16.241427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:16.253382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be10b7-5287-4e9d-9d89-dcdc1269864b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.292010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.293101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.293603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.294099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.295024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:16.295555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.297181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.302956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db286003-e929-4087-8ede-21049a435e53 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.304965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 473/970] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:16.310392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:16.331098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:16.347999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.349454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.349737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.350008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.358380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.361085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:16.378810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:16.379790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:16.380706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:16.383937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 498/971] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:16.388098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:16.436547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9c57f-e4ee-417a-9399-11f0a5b23d0f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.473210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.473868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.474151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.474423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.475292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.476559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.504032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 474/972] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:16.504227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907c27-32a1-45a0-8fda-122fe311820b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.552190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.552872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.553248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.553527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.554340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:16.554650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.556232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542191-b1ae-4329-bd0f-dcadd0d57373 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.571524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 499/973] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:16.577609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:16.592957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:16.695207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f48730-b848-4e5b-9002-0ccf07c16bfc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:16.729538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:16.730196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:16.730477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:16.730752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:16.731588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] RBAC: Adding query filter params (role.id=489b909a965c4b11a83b2c5fc843f17e, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=52b394e0a6464e1592af1956cabc52f0) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:16.731928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:16.733364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0c7e4-791f-4c5c-a6f6-f30e12e19daf None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:16.743961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 475/974] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:16 2022] GET /identity/v3/role_assignments?user.id=52b394e0a6464e1592af1956cabc52f0&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=489b909a965c4b11a83b2c5fc843f17e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:17.341892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed2a8-9dcf-41ef-87ec-ed8f77d2b87a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:17.342633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed2a8-9dcf-41ef-87ec-ed8f77d2b87a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:17.342633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed2a8-9dcf-41ef-87ec-ed8f77d2b87a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:17.343996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 500/975] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:17.350196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:17.350689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:17.350861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:17.367549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:17.368764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:17.437707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 476/976] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:17.467335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed2a8-9dcf-41ef-87ec-ed8f77d2b87a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:17.512974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:17.576729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed2a8-9dcf-41ef-87ec-ed8f77d2b87a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:17.612452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:17.613038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:17.613319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:17.613593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:17.614299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:17.615731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:17.617062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING keystone.server.flask.common [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 18:26:17.629933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.sql.core [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 18:26:17.629933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 18:26:17.629933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [parameters: {'user_id': '10d11844abe94dc782c83963dd279a27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 18:26:17.629933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jun 22 18:26:17.638439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 18:26:17.639310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application yield resource Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise self.value Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application session.commit() Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 18:26:17.640319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.flush() Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application compat.raise_( Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 18:26:17.641230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 18:26:17.642431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 18:26:17.643313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [parameters: {'user_id': '10d11844abe94dc782c83963dd279a27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:17.645538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 18:26:17.647525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:17.657879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 501/977] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 18:26:17 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:17.658928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:17.668195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:17.769432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd403-b5ee-4dd8-8185-3c81928fd089 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:17.809499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:17.810299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:17.810586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:17.810867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:17.818892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:17.820445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-975149c1-4349-4d7e-9aaa-e4eb2056a5e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:17.836186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:17.837154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:17.838533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 477/978] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:17.843863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:17.956059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:17.959320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb94c3-5494-43e4-9627-a5e0c42430f8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:17.997696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:17.998372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:17.998656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:17.998932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:17.999735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:18.000073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:18.002761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c0ea-6850-4cde-a2c5-a4670f971b52 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:18.042558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 502/979] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 18:26:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:18.288996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e98e9-abbf-4ddc-afac-de1b1dd45fc3 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.289401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e98e9-abbf-4ddc-afac-de1b1dd45fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.289573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e98e9-abbf-4ddc-afac-de1b1dd45fc3 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.290980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 478/980] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:18.296445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b635a4-3ab3-49b0-b433-deb295d28b96 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.296740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b635a4-3ab3-49b0-b433-deb295d28b96 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.297020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b635a4-3ab3-49b0-b433-deb295d28b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.315086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-87b635a4-3ab3-49b0-b433-deb295d28b96 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:18.316634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-87b635a4-3ab3-49b0-b433-deb295d28b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:18.387201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 503/981] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:18.408958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e98e9-abbf-4ddc-afac-de1b1dd45fc3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:18.479584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:18.521614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e98e9-abbf-4ddc-afac-de1b1dd45fc3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:18.556583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1f8e0-a33c-4255-9616-f3295f264b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:18.557161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1f8e0-a33c-4255-9616-f3295f264b6b None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.557442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1f8e0-a33c-4255-9616-f3295f264b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.557717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1f8e0-a33c-4255-9616-f3295f264b6b None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.558452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1f8e0-a33c-4255-9616-f3295f264b6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:18.559818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1f8e0-a33c-4255-9616-f3295f264b6b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:18.579873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 479/982] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:18 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:18.689956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d46d72-9b63-4010-812c-d6288bfeebce None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.690317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d46d72-9b63-4010-812c-d6288bfeebce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.690522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d46d72-9b63-4010-812c-d6288bfeebce None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.691958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 504/983] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:18.697533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2ffe-b3b8-4126-9481-bbb6c93f4795 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.697827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2ffe-b3b8-4126-9481-bbb6c93f4795 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.698111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2ffe-b3b8-4126-9481-bbb6c93f4795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.717060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ca6a2ffe-b3b8-4126-9481-bbb6c93f4795 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:18.718282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ca6a2ffe-b3b8-4126-9481-bbb6c93f4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:18.807004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 480/984] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:18.830906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d46d72-9b63-4010-812c-d6288bfeebce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:18.874946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9e63-0400-4565-b18b-a839622dd803 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.875245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9e63-0400-4565-b18b-a839622dd803 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.875528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9e63-0400-4565-b18b-a839622dd803 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.877642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 481/985] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:18.882612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.882977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.883182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.900680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:18.901831 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:18.927303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:18.941788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d46d72-9b63-4010-812c-d6288bfeebce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:18.957349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:18.978120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:18.979058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:18.979355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:18.979641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:18.980341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:18.981729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:18.984644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 482/986] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:18.994348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:18.995343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:18.996328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 505/987] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:19.002041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.010129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.113821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4c79f-a33b-4804-825d-4b6038816239 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.116561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb7c4-31c0-4b1d-8682-cbd43a96b3fd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.149702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.150402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.150692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.150973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.151684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:19.152027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.153208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.153416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.153954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.154241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.154522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.155173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.156556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.159141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 483/988] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:19.164437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:19.168561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:19.169850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:19.170882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:19.174910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 506/989] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:19.175724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.194048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:19.220329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:19.278566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8819ecf-1608-4018-a2ea-1e54df22c9a2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.281247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5ca0-b0a1-41a3-8994-1f91b871f5da None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.315129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.315796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.316107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.316391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.316727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.317106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:19.317384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.317481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.317667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.317939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.318637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:19.318817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.318967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.320440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.324030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 484/990] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:19.329567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.335253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 507/991] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:19.336875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.421492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:19.441939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317b1a-99b4-4d85-a2e5-04b385416e8f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.442593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93881f-cc36-48be-9231-70d04b55a3d0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.452341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:19.480447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.481196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.481551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.481830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.482535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:19.482845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.483005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.483628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.483942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.484223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.484318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.485688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] RBAC: Adding query filter params (interface=admin, service_id=206c34d4b0504fda9e4cbc9f969f8c2c, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:19.486170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.487230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcfea7-b84d-431c-8ff3-f7c082c8437e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.500114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 508/992] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:19.503415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 485/993] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/endpoints?service_id=206c34d4b0504fda9e4cbc9f969f8c2c&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:19.509505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:19.619070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986bd26-c480-4b46-a470-03fd9c27e129 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:19.655273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ffdf9-a254-40aa-817c-e73f4e13d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:19.655965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ffdf9-a254-40aa-817c-e73f4e13d37e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:19.656252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ffdf9-a254-40aa-817c-e73f4e13d37e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:19.656530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ffdf9-a254-40aa-817c-e73f4e13d37e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:19.657617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ffdf9-a254-40aa-817c-e73f4e13d37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:19.659115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ffdf9-a254-40aa-817c-e73f4e13d37e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:19.667141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 509/994] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:26:19 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:26:20.646428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543937-d641-4661-8864-c34cc4c99f6a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:20.646991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543937-d641-4661-8864-c34cc4c99f6a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:20.646991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543937-d641-4661-8864-c34cc4c99f6a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:20.648424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 486/995] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:20.653447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:20.653888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:20.654034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:20.671270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:20.673129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:20.675354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:20.742940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 510/996] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:20.769626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543937-d641-4661-8864-c34cc4c99f6a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:20.871071 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543937-d641-4661-8864-c34cc4c99f6a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:20.904320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:20.905034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:20.905324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:20.905589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:20.906238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:20.908135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:20.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:20.920869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:20.921696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:20.923630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 487/997] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:20.927308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:21.028121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890732-6d5d-4ef4-9ed7-0e0e5a62dbc2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:21.064500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:21.065161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.065443 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.065715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.066414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:21.066719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:21.068119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:21.077390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 511/998] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:21.078648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:21.116140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:21.182604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b2ba-0e48-474a-b712-34c2ba523aaa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:21.215634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:21.216321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.216606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.216876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.217576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:21.217888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:21.219746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:21.224753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 488/999] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:21.230238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:21.233084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:21.331504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c3d58-aac3-4aea-98f4-f2e0566e691f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:21.364592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:21.365251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.365536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.365813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.366598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] RBAC: Adding query filter params (interface=public, service_id=322c06ef2d634fccabf77be08c5bd4ce, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:21.366912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:21.368305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37f2f4-a490-4272-a80d-d6a150ce8878 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:21.378387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 512/1000] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:26:21 2022] GET /identity/v3/endpoints?service_id=322c06ef2d634fccabf77be08c5bd4ce&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:21.379639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:21.477988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:21.481750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f812-cb65-4984-8abd-7d66e7ca5a78 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:21.515945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c485ae-aac7-467a-949c-3d1ebe28bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:21.516627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c485ae-aac7-467a-949c-3d1ebe28bb2e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.516915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c485ae-aac7-467a-949c-3d1ebe28bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.517188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c485ae-aac7-467a-949c-3d1ebe28bb2e None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.517867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c485ae-aac7-467a-949c-3d1ebe28bb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:21.519227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c485ae-aac7-467a-949c-3d1ebe28bb2e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:21.531873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 489/1001] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:26:21 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:26:21.572680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bbec8-6402-4475-b088-45bb595e961a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.572981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bbec8-6402-4475-b088-45bb595e961a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.573273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bbec8-6402-4475-b088-45bb595e961a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.575032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 513/1002] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:21.582215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326599b1-babf-4c1e-9fdb-a4a611796c1c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.582545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326599b1-babf-4c1e-9fdb-a4a611796c1c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.582789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326599b1-babf-4c1e-9fdb-a4a611796c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.601123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-326599b1-babf-4c1e-9fdb-a4a611796c1c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:21.602350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-326599b1-babf-4c1e-9fdb-a4a611796c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:21.681227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 490/1003] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:21.703985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bbec8-6402-4475-b088-45bb595e961a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:21.725788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37cc22-291e-4e28-83d0-aaecb89f0a17 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.726097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37cc22-291e-4e28-83d0-aaecb89f0a17 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.726358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37cc22-291e-4e28-83d0-aaecb89f0a17 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.727728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 491/1004] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:21.733529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.733744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.734021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.757568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:21.758767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:21.780489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:21.821702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bbec8-6402-4475-b088-45bb595e961a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:21.834972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 492/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:21.858010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:21.862020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:21.862694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:21.862980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:21.863257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:21.864082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:21.865467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:21.882288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 514/1006] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:21 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:26:21.892456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:21.978473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc439d2-3c2f-4feb-b013-cfe0ce401d1d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:22.022286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:22.023107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:22.023449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:22.023729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:22.024433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:22.025903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:22.039209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:22.040291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:22.041147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 493/1007] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 18:26:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:22.046751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:22.150569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109bd6-76e8-4343-a18f-e77dbc356111 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:22.176278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:22.187168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:22.187848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:22.188255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:22.188536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:22.189251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:22.189562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:22.190938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:22.196030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 515/1008] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:22.204103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:22.289067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:22.306240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aabf5-99a2-4e6f-b2ec-8bc844a5fcb6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:22.339483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:22.340171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:22.340462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:22.340736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:22.341435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:22.341742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:22.343098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f284c-754b-494c-852f-1efd20950f3a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:22.348232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 494/1009] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 18:26:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:22.353655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:22.455049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328360-45b9-4b83-8b46-271f9b577072 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:22.488679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afc0fe-876e-4ac4-ad94-4d7e2b69b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:22.489331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afc0fe-876e-4ac4-ad94-4d7e2b69b083 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:22.489613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afc0fe-876e-4ac4-ad94-4d7e2b69b083 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:22.489889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afc0fe-876e-4ac4-ad94-4d7e2b69b083 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:22.490625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afc0fe-876e-4ac4-ad94-4d7e2b69b083 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:22.492015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afc0fe-876e-4ac4-ad94-4d7e2b69b083 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:22.508964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 516/1010] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:23.631898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601375e-e9b2-4b80-be93-027c49b04248 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:23.632721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601375e-e9b2-4b80-be93-027c49b04248 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:23.632721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601375e-e9b2-4b80-be93-027c49b04248 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:23.634353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 495/1011] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:23.639926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:23.640400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:23.640583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:23.657941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:23.659138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:23.710490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:23.739691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 517/1012] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:23 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:23.762778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601375e-e9b2-4b80-be93-027c49b04248 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:23.870516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601375e-e9b2-4b80-be93-027c49b04248 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:23.906203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:23.907440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:23.907725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:23.908033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:23.908692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:23.910059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ca2d030a-2057-4bec-aa1f-ee7e961ec215 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:23.921946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:23.922956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 18:26:23.923811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:23.925305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 496/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:23.929081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.026244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb02def-be34-451d-98be-e6399f0054cb None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.026594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb02def-be34-451d-98be-e6399f0054cb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.026809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb02def-be34-451d-98be-e6399f0054cb None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.032025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 497/1014] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:24.033721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.034174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.034452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.035811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5136d2-3abb-45ce-9b5d-eb7fd6296162 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.051088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:24.052333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:24.059756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.075203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.075909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.076199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.076490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.077195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:24.077510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.080206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.089669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 518/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:24.090723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.128870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 498/1016] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:24 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:24.141780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.155632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.212214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561a3b-7679-458c-83be-a9e4d88ecf6d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.249801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.251269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.251562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.251865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.252604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:24.252917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.254290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.263915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 519/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:24.264918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.274141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b8cd-aa10-45aa-9b07-09df6b26b0af None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.312707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.314082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.314281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.315015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] PATH_INFO: `/v3/services/image` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.315956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.317597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:24.330637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:24.331675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:24.333222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 499/1018] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:24.337549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.347255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.376480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3fc3-0034-4d91-acc8-b2e2970ef9f9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.379542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.415259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.415940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.416230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.416510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.417249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.418623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.447868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 520/1019] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:26:24.458087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538ab64-0431-433e-8861-f395519ce238 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.505414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.506109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.506384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.506652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.507628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] RBAC: Adding query filter params (name=image) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:24.507968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.509368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e338128-0e73-4c48-8f88-1f7ceefd873a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.520614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 500/1020] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:24.522336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.613324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ff04-3c4f-490f-91ef-702e68e22704 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.613615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ff04-3c4f-490f-91ef-702e68e22704 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.613890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ff04-3c4f-490f-91ef-702e68e22704 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.615260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 501/1021] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:24.620263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.620554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.620835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.637838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63739-0797-455a-a8f9-45002e72a7a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.641979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:24.643194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:24.678558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.679855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.680184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.680461 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.681170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:24.681481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.682848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.688367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 521/1022] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:24.694675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.714887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.724240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.724431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 502/1023] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:24.748665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.812524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ceb2-bb44-4d67-a5f4-67c6294f6a0e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.848718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.849381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.849674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.849958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.850759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] RBAC: Adding query filter params (interface=public, service_id=6c0f75bf5f27482bbd763ae2ac336821, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:24.851086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.852536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.857814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 522/1024] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/endpoints?service_id=6c0f75bf5f27482bbd763ae2ac336821&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:24.860240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076124a7-7141-481c-bb27-e2ff722ec5c1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.863514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.903005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:24.903970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:24.904225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:24.904501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:24.905821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:24.907412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:24.914275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 503/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:24.915103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:24.953509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:24.967756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e5601-0cda-407e-ae55-9901bf31c8f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:24.980037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:25.005542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211b21-9365-4e3b-80d5-110b42ccd19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:25.006369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211b21-9365-4e3b-80d5-110b42ccd19e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:25.006658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211b21-9365-4e3b-80d5-110b42ccd19e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:25.007204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211b21-9365-4e3b-80d5-110b42ccd19e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:25.008957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b211b21-9365-4e3b-80d5-110b42ccd19e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:25.011146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b211b21-9365-4e3b-80d5-110b42ccd19e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:25.024143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 523/1026] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:26:24 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:26:25.024332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76c717-b0cf-458b-a832-ced134d623f9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:25.059201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca2c43-280e-4142-a479-0a3111318160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:25.059897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca2c43-280e-4142-a479-0a3111318160 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:25.060189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca2c43-280e-4142-a479-0a3111318160 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:25.060472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca2c43-280e-4142-a479-0a3111318160 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:25.061209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca2c43-280e-4142-a479-0a3111318160 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:25.062672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca2c43-280e-4142-a479-0a3111318160 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:25.091563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 504/1027] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:24 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:26.677268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003094e-ee6d-44b1-a13d-ef8b80c4aaf4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:26.677795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003094e-ee6d-44b1-a13d-ef8b80c4aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:26.677873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003094e-ee6d-44b1-a13d-ef8b80c4aaf4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:26.679238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 524/1028] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:26.684319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:26.684713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:26.684884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:26.702520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:26.704329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:26.784699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 505/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:26.814506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003094e-ee6d-44b1-a13d-ef8b80c4aaf4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:26.921488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003094e-ee6d-44b1-a13d-ef8b80c4aaf4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:26.958724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326c9d-c754-473b-bfa1-5e66ae389794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:26.959465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326c9d-c754-473b-bfa1-5e66ae389794 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:26.959752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326c9d-c754-473b-bfa1-5e66ae389794 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:26.960055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326c9d-c754-473b-bfa1-5e66ae389794 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:26.971513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326c9d-c754-473b-bfa1-5e66ae389794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-24326c9d-c754-473b-bfa1-5e66ae389794 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:26.979709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:26.980799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:26.981652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:26.984143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 525/1030] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 18:26:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:26.986734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.035111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.063436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0809e-0957-441e-83ea-9120c736b632 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.063944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0809e-0957-441e-83ea-9120c736b632 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.064288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0809e-0957-441e-83ea-9120c736b632 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.065801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 526/1031] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:27.070624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.070905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.071183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.088515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:27.089692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:27.093861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eada61-5917-4e86-8fd5-e6bece194839 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.097368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.130299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.130959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.131240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.131517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.132557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:27.132864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.134220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.143075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 506/1032] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:26:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:27.148379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.164012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 527/1033] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:27.186496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.258491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb28960-df96-407f-9145-4d55f5bf0836 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.269417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.298297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1c255-47d7-4dc8-96dc-ec7e23c6fa95 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.300742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.301841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.302132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.303194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.318761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.319979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-fb29321e-993e-4f0f-908c-3f4b16cd3aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:27.339659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:27.340709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:27.341613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:27.341613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:27.341613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:27.341613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:27.341613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 507/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:27.342432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e97f-9e63-4a82-84f7-d759dc48ddf3 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.342542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e97f-9e63-4a82-84f7-d759dc48ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.342757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e97f-9e63-4a82-84f7-d759dc48ddf3 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.344915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 508/1035] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:27.347133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.347295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e97f-9e63-4a82-84f7-d759dc48ddf3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.347964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.348255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.348532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.349200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.350581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-03ff51d4-589d-4f27-a6db-429d3066d4e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:27.362223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:27.363252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:27.364286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 528/1036] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:27.365313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.365313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.365313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.376913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.382457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:27.383637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:27.455843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 529/1037] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:27.456740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.463799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e97f-9e63-4a82-84f7-d759dc48ddf3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.511872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.512457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.513835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.514113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.516351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:27.516725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.518944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.530870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 509/1038] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:27.533985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.557999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.576436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd49fe2-5f8c-4918-9679-c26633c5008c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.614862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.615525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.615808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.616114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.616826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] RBAC: Adding query filter params (name=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:27.618172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.619577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.621442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.627925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 530/1039] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:27.629565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.662489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea585b-89f5-46fb-86ea-d883c76b7502 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.708935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.709727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.710010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.710282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.711808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.713276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.714942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 510/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:27.715772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.762840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32333708-b26e-4c8b-b59d-bdecdf1b8792 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.803514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.804390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.804670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.804947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.813313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.813513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.814919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.826768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ee59d-f81d-4b84-b67a-f2c301239f76 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:27.830048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:27.831017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:27.832013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 531/1041] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:27.832631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.864378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.865046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.865331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.865615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.866361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] RBAC: Adding query filter params (type=image) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:27.866673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.868089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.873154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 511/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:27.873966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:27.897156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:27.941131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f927aa-6323-43f8-ac66-4b90d717464c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:27.977885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:27.978556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:27.978876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:27.979176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:27.979923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:27.981367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:27.989383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc3d4a-c033-4392-a959-bbefb632153f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:28.005961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 532/1043] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:26:27 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:28.007514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:28.044316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:28.046431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:28.046431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:28.046431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:28.046701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:28.048259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:28.049705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:28.075825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 512/1044] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:26:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:28.082873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:28.097257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:28.158793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34b17-1440-41aa-a92f-26edee9b912f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:28.182262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:28.204604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:28.205266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:28.205553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:28.205835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:28.206655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:28.208057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:28.224009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1d236-5747-49a9-b1ec-3aaa9a91e73c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:28.231207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 533/1045] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:26:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:28.275634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:28.276496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:28.276884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:28.277264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:28.354325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:28.355930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:28.366122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:28.468420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 513/1046] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:28.474957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:28.580352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48769b-fb87-4df3-875e-0cc8608554e2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:28.615680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:28.616741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:28.617186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:28.617614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:28.629112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:28.630806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:28.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:28.651618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:28.659271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:28.659271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:28.659271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:28.659271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:28.659271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 534/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:28.660316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:28.775526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77eef-4d89-4500-83f0-2b6dec688a10 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:28.784271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:28.812248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:28.812981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:28.813296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:28.813530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:28.814259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:28.814571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:28.816038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:28.832819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 514/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:28.834027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:28.862900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:28.940021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc071e-3ff0-4341-bc01-ad120fbbe7ec None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:28.974471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:28.975269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:28.975649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:28.975959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:28.982625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:28.984107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:28.998527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:28.999431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:29.000511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 535/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:29.007463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:29.118011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e1a25-2818-40e8-b517-0900d68d1dde None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:29.152441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:29.153091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:29.153376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:29.153652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:29.154435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:29.154748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:29.156203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c6b0-dcb6-4657-a1a3-976f44c063fc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:29.168734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 515/1050] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:29.175065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:29.265112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:29.282409 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08a2f-c03f-4556-b38a-bb0a82a9b625 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:29.317124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:29.317784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:29.318075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:29.318356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:29.319193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] RBAC: Adding query filter params (role.id=489b909a965c4b11a83b2c5fc843f17e, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=fd8232022633460fbaa7479477d4014d) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:29.319517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:29.320999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d97e5-7c92-4194-aa80-fa3998088885 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:29.326855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 536/1051] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:29 2022] GET /identity/v3/role_assignments?user.id=fd8232022633460fbaa7479477d4014d&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=489b909a965c4b11a83b2c5fc843f17e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:30.178401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233fc8b-9d9a-4cb0-8aae-a19e1279c864 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.178898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233fc8b-9d9a-4cb0-8aae-a19e1279c864 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.178898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233fc8b-9d9a-4cb0-8aae-a19e1279c864 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.180427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 516/1052] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:30.185255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b6915-d9d8-4fd1-9e72-4445db3be0c7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.185637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b6915-d9d8-4fd1-9e72-4445db3be0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.185804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b6915-d9d8-4fd1-9e72-4445db3be0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.202847 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b65b6915-d9d8-4fd1-9e72-4445db3be0c7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:30.204207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b65b6915-d9d8-4fd1-9e72-4445db3be0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:30.272806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 537/1053] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:30.296496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233fc8b-9d9a-4cb0-8aae-a19e1279c864 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.298472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca32c-a5ab-43ec-b4be-d28f1a886c46 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.298767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca32c-a5ab-43ec-b4be-d28f1a886c46 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.299047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca32c-a5ab-43ec-b4be-d28f1a886c46 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.300708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 538/1054] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:30.305767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.306057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.306336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.324067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:30.325240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:30.325788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:30.398082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 539/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:30.402164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233fc8b-9d9a-4cb0-8aae-a19e1279c864 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:30.420286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.432639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:30.437915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:30.438758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.439054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.439321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.450580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:30.459300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:30.460283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:30.461196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 517/1056] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:30.466615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.535931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdbc94-0a77-4727-a4c7-63575d1f1bdc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:30.554412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:30.571667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:30.572344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.572628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.572903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.573061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf78238-6dca-4f86-b491-e99703ee1664 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:30.612077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:30.612738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.613021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.613294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.614031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:30.614339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:30.615730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:30.624627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 518/1057] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:30.631369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.649169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:30.650725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:30.661550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:30.734893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15778bf4-9f9e-415d-85d0-90dbe83d96ad None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:30.756636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 540/1058] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:30.764794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.784412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:30.785300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.785586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.785863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] PATH_INFO: `/v3/users/dda975bf644a460997670f4a5b6c9b66` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.800094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] RBAC: Authorizing `identity:get_user(user_id=dda975bf644a460997670f4a5b6c9b66)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:30.801551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:30.803261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 519/1059] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/users/dda975bf644a460997670f4a5b6c9b66 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:30.809076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.818952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:30.869577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf876-d867-4222-8d60-fd9d03ab01ca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:30.880328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:30.906950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:30.907753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.908066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.908347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:30.918499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:30.919514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83475-ac04-4a0b-81f1-9229658213c1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:30.919993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:30.941052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:30.942179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:30.943285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:30.943285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:30.943285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:30.943285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:30.947413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 541/1060] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:30.948279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:30.959207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:30.959871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:30.960474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:30.960751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.035789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:31.037278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:31.045175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:31.055585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c491-cb27-47ab-88c3-82c8df032eaa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:31.095059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:31.096039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.096039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.096340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.097071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:31.097386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:31.098775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:31.111388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 542/1061] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:31.145231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 520/1062] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:31.151550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:31.177880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:31.267982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f483d4-67d0-4c57-ab92-29ba5e8f4206 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:31.308764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e68299-d809-4e3b-ad8d-1ebf3d39912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:31.309871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68299-d809-4e3b-ad8d-1ebf3d39912b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.310301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68299-d809-4e3b-ad8d-1ebf3d39912b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.310730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68299-d809-4e3b-ad8d-1ebf3d39912b None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.312115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e68299-d809-4e3b-ad8d-1ebf3d39912b None admin] RBAC: Authorizing `identity:get_project(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:31.313918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e68299-d809-4e3b-ad8d-1ebf3d39912b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:31.315870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 543/1063] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:31 2022] GET /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:31.321702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:31.382931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74201a0-897d-4003-a7e0-73674203e0c3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.383215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74201a0-897d-4003-a7e0-73674203e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.383495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74201a0-897d-4003-a7e0-73674203e0c3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.384903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 544/1064] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:31.390202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.390562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.391606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.411960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:31.413040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:31.426678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc430714-1ff9-408a-82f8-57b417bb670a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:31.434110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:31.462418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:31.463073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.463380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.463630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.464494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf, user.id=dda975bf644a460997670f4a5b6c9b66) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:31.464809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:31.466248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:31.471738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 521/1065] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:31 2022] GET /identity/v3/role_assignments?user.id=dda975bf644a460997670f4a5b6c9b66&scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:31.494907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 545/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:31.519401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:31.622505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da06f7-2f50-4dc9-9228-d5fba5740c08 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:31.657027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:31.657835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.658122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.658399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.668357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:31.676608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:31.677533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:31.678377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 522/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 18:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:31.683861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:31.702667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:31.785249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1faf39-4733-49b0-af86-c8b51b1efb76 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:31.818714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:31.819379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.819663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.819979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.820722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:31.821033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:31.822405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:31.830420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 546/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:31.835872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:31.866328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:31.935000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398caf54-b9dd-49aa-bb9a-d9a11078796e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:31.967847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:31.968668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:31.968989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:31.969501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:31.982536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:31.984043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:32.002113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:32.003008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:32.003938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:32.003938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:32.003938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:32.003938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:32.003938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 523/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:32.009299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:32.086286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:32.105320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d92d5-db1d-424f-85be-43fb2edee966 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:32.139118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:32.139780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:32.140093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:32.140369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:32.141139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:32.141452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:32.142820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.154402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 547/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:32.160789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:32.240812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:32.259648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaf8f-5b2c-4e52-8a42-4aea70dbda3f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:32.292083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:32.292860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:32.293141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:32.293414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:32.300735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:32.302152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:32.316129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:32.317239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:32.318267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 524/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:32.322975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:32.418301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf37df-777f-401f-ba56-79f3f0638710 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:32.450855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:32.451515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:32.451801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:32.452108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:32.452940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:32.453338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:32.454770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.463240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:32.473179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 548/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:32.478712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:32.580914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b704-bb3d-4810-b982-c6ddc6afbe60 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:32.614193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:32.614989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:32.615274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:32.615551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:32.626960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:32.628443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.630122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:32.646282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:32.647194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:32.648325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:32.648325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:32.648325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:32.648325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:32.648325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 525/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:32.653078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:32.757546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377f228-a8c9-4207-8e5a-509e1264831a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:32.790593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:32.791251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:32.791536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:32.791810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:32.792557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:32.792867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:32.794227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.805591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 549/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:32.811183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:32.907856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a87b-833c-41fa-82e2-de3b057ab2a2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:32.940328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:32.941099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:32.941379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:32.941655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:32.948119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:32.949528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:32.963389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:32.964355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:32.965303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 526/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:32.970963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:33.031071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:33.077067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ba21-69a2-482f-a40a-7bc7a536bda1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:33.112194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:33.112844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:33.113126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:33.113397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:33.114175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:33.114484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:33.115928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723f49e-f65b-402c-b3dc-b14853f12257 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:33.128292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 550/1076] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:33.134385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:33.189141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:33.233248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ca4a5-ce0d-4482-9a4d-797e085e76bf None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:33.266946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e92d-5155-4106-8d37-fea85cb822f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:33.267856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e92d-5155-4106-8d37-fea85cb822f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:33.268153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e92d-5155-4106-8d37-fea85cb822f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:33.268430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e92d-5155-4106-8d37-fea85cb822f8 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/fd8232022633460fbaa7479477d4014d/roles/489b909a965c4b11a83b2c5fc843f17e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:33.270637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6e92d-5155-4106-8d37-fea85cb822f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=fd8232022633460fbaa7479477d4014d, role_id=489b909a965c4b11a83b2c5fc843f17e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:33.272115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6e92d-5155-4106-8d37-fea85cb822f8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:33.286368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 527/1077] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:26:33 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/fd8232022633460fbaa7479477d4014d/roles/489b909a965c4b11a83b2c5fc843f17e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:26:33.500117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9cdb-013b-4e51-a109-b49159f8f566 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:33.500883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9cdb-013b-4e51-a109-b49159f8f566 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:33.500883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9cdb-013b-4e51-a109-b49159f8f566 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:33.502210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 551/1078] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:33.507903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:33.508313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:33.508462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:33.525523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:33.526698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:33.592227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 528/1079] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:33.614872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df9cdb-013b-4e51-a109-b49159f8f566 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:33.724086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df9cdb-013b-4e51-a109-b49159f8f566 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:33.741999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:33.760133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:33.760933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:33.761219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:33.761496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:33.772528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:33.780345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:33.781696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:33.782549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 552/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:33.787769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:33.831870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:33.883894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019f903-cc67-402e-8077-ecbf630e9cdf None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:33.916478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:33.917140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:33.917423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:33.917697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:33.918439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:33.918746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:33.920122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:33.928385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 529/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:33.936876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:34.037667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ad1b-ff11-4813-9db6-ce59f61a08d4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:34.070531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:34.071515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:34.071907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:34.072259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] PATH_INFO: `/v3/users/dda975bf644a460997670f4a5b6c9b66` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:34.073531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] RBAC: Authorizing `identity:get_user(user_id=dda975bf644a460997670f4a5b6c9b66)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:34.074983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:34.076688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 553/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:33 2022] GET /identity/v3/users/dda975bf644a460997670f4a5b6c9b66 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:34.082491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:34.185650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c100f-9f63-4fed-a7f3-dd7c2c10b9f0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:34.193069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:34.219575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb5fde-666d-43a8-9c42-b52d844a0725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:34.220460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb5fde-666d-43a8-9c42-b52d844a0725 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:34.220752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb5fde-666d-43a8-9c42-b52d844a0725 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:34.221034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb5fde-666d-43a8-9c42-b52d844a0725 None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:34.222224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb5fde-666d-43a8-9c42-b52d844a0725 None admin] RBAC: Authorizing `identity:get_project(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:34.223661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb5fde-666d-43a8-9c42-b52d844a0725 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:34.225408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 530/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:34 2022] GET /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:34.231249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:34.280439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:34.333605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327566-3ccf-4e02-af92-5749366873b9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:34.366715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885b670-e4e6-4ccb-8e9c-33a4b453c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:34.367606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885b670-e4e6-4ccb-8e9c-33a4b453c836 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:34.368057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885b670-e4e6-4ccb-8e9c-33a4b453c836 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:34.368345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885b670-e4e6-4ccb-8e9c-33a4b453c836 None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf/users/dda975bf644a460997670f4a5b6c9b66/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:34.370331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885b670-e4e6-4ccb-8e9c-33a4b453c836 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf, user_id=dda975bf644a460997670f4a5b6c9b66, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:34.371775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885b670-e4e6-4ccb-8e9c-33a4b453c836 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:34.385444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 554/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:26:34 2022] PUT /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf/users/dda975bf644a460997670f4a5b6c9b66/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:26:35.307988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bbc0d-7b61-49c4-9be4-184789c1c8b4 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:35.308852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bbc0d-7b61-49c4-9be4-184789c1c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:35.309131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bbc0d-7b61-49c4-9be4-184789c1c8b4 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:35.310510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 531/1085] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:35.315692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:35.316131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:35.316415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:35.333182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:35.334350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:35.398457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 555/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:35.421579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bbc0d-7b61-49c4-9be4-184789c1c8b4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:35.523359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bbc0d-7b61-49c4-9be4-184789c1c8b4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:35.556471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:35.557269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:35.557550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:35.557822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:35.568121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:35.576107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:35.577191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:35.578148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 532/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 18:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:35.583234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:35.619517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:35.681401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2ecc-0127-4ca6-be9e-930b35ba2dfb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:35.714281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:35.714933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:35.715214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:35.715488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:35.716257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:35.716566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:35.717923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:35.725592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 556/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:35.731171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:35.765976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:35.832978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d5c98-d1f7-4f72-8b57-02de34d8d60a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:35.865665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:35.866449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:35.866732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:35.867007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:35.877815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:35.879259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:35.896769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:35.897871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:35.898837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:35.898837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:35.898837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:35.898837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:35.898837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 533/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:35.903629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:35.997623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.002605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6642339-4152-4061-a1d6-610b8fed1980 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.036244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.036900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.037185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.037460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.038177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:36.038486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.039860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.051143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 557/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:36.056703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.141857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.157173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6719f-a1c4-4989-8308-7862cbe8dafa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.190342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.191119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.191398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.191674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.198979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.200446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:26:36.215230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:36.216366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:36.217356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 534/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:36.222161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.319534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9fa08-8b7b-4aad-ab63-18077c8b678d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.351970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.352865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.353149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.353420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.354243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:36.354552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.356004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b80b1-7810-4219-bae7-93f247b9f8d9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.372988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 558/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:36.379261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.416726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599a7e0-5e83-40d8-8373-61e874ebada5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.416918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599a7e0-5e83-40d8-8373-61e874ebada5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.417199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599a7e0-5e83-40d8-8373-61e874ebada5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.418561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 559/1093] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:26:36.424121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.424410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.424695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.442072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:36.443249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:36.454413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.478600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e9b45-bd25-4de7-9b84-c55bf8e547ac None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.511519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 560/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:36.512026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.512676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.512964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.513241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.528278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.535236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.581857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.583420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.632243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaddb8f-2508-44fd-a24b-04a9bdb93b7d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.665209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.665994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.666279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.666553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.677269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:36.684615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 535/1095] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:36.684822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:36.685893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:36.686777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:26:36.687477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.687550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 561/1096] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:36.691796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.700689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.733536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.792033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165aa0a-e0b3-44a5-a04a-f9dfa85e1d34 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.792947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c5efa-b445-4f9f-9f9f-cfadc09f1f09 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.825782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.826570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.826857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.827134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.827227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.828514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.828862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.829090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.829836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:36.830150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.831522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.838184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.839608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.839716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 562/1097] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:36.845758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:26:36.856944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:36.857891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:36.859480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:26:36.859480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:26:36.859480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:26:36.859480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:36.859480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 536/1098] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:36.863485 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.913359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.947519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84756-f242-4c59-8614-8d418c12266a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.957881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:36.961695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580d1e-f912-4f86-a176-5c6c813ee818 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:36.981253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.982149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.982429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.982699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] PATH_INFO: `/v3/users/dda975bf644a460997670f4a5b6c9b66` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.983928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] RBAC: Authorizing `identity:get_user(user_id=dda975bf644a460997670f4a5b6c9b66)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.985851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:36.987481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 563/1099] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/users/dda975bf644a460997670f4a5b6c9b66 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:36.993027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:36.995562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:36.996286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:36.996578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:36.996849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:36.997580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:36.997897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:36.999250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.011890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 537/1100] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:37.017696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:37.091245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c320-24bc-40ec-8fc6-637a48763b3d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:37.119908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd524c-7596-4279-8f66-72e21753ac18 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:37.124522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:37.125288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:37.125577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:37.125855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:37.129329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:37.155392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:37.156959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:37.157295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:37.157568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:37.164058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:37.165496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:26:37.179434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:37.180391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:37.181291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 538/1101] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:26:37.186256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:37.194695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:37.196185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.208129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:37.288861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967de473-b103-4e34-aa6f-843d76f41019 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:37.296571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 564/1102] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:26:37.302107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:37.322879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:37.323536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:37.323818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:37.324123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:37.324913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:37.325224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:37.326655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.334811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:37.338550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 539/1103] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:37.345012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:37.400374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ee49-2b54-4b44-866e-b531b0fd7c06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:37.420628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:37.433615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:37.434475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:37.434767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:37.435040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:37.436259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] RBAC: Authorizing `identity:get_project(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:37.438223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.439937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 565/1104] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:37 2022] GET /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:37.444728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dabd8b-0741-4711-a785-00cd13387801 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:37.445837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:37.478600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:37.479179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:37.479471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:37.479752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:37.480615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] RBAC: Adding query filter params (role.id=489b909a965c4b11a83b2c5fc843f17e, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=fd8232022633460fbaa7479477d4014d) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:37.480932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:37.482359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0d518-a9db-4a82-a5c6-fbc792db6a04 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.489169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 540/1105] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:37 2022] GET /identity/v3/role_assignments?user.id=fd8232022633460fbaa7479477d4014d&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=489b909a965c4b11a83b2c5fc843f17e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:37.552569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2bd6f-086f-4c8c-be29-d7b66a8886a7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:37.555069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:37.589310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:37.589979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:37.590268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:37.590550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:37.591406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf, user.id=dda975bf644a460997670f4a5b6c9b66) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:37.591727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:37.593267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b7da-be99-494a-86d1-13a4e8d89d7b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:37.600946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 566/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:37 2022] GET /identity/v3/role_assignments?user.id=dda975bf644a460997670f4a5b6c9b66&scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:39.656676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f23ba-3fcb-4209-b5d3-a5ca3fe97fdb None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:39.657248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f23ba-3fcb-4209-b5d3-a5ca3fe97fdb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:39.657347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f23ba-3fcb-4209-b5d3-a5ca3fe97fdb None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:39.658694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 541/1107] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:39.663758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:39.664208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:39.664346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:39.681548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:39.682719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:39.745779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 567/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:39.771067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f23ba-3fcb-4209-b5d3-a5ca3fe97fdb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:39.869926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f23ba-3fcb-4209-b5d3-a5ca3fe97fdb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:39.901842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3e23b-151e-4090-99e2-552b76f35edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:39.902617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3e23b-151e-4090-99e2-552b76f35edb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:39.902903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3e23b-151e-4090-99e2-552b76f35edb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:39.903179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3e23b-151e-4090-99e2-552b76f35edb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:39.904379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3e23b-151e-4090-99e2-552b76f35edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:39.906309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3e23b-151e-4090-99e2-552b76f35edb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:39.907993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 542/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:39.913694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:40.010690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:40.014857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e78e-9213-4829-b80b-aaaadb751394 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:40.049765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ee7f-4b94-4e14-8d0a-91f796a9a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:40.050426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ee7f-4b94-4e14-8d0a-91f796a9a4a8 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:40.050716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ee7f-4b94-4e14-8d0a-91f796a9a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:40.050994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ee7f-4b94-4e14-8d0a-91f796a9a4a8 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:40.051692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ee7f-4b94-4e14-8d0a-91f796a9a4a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:40.053157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ee7f-4b94-4e14-8d0a-91f796a9a4a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:40.073286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 568/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:26:39 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:42.117386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877511-7305-442e-9dc5-34cb387fa6c2 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:42.117901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877511-7305-442e-9dc5-34cb387fa6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:42.117901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877511-7305-442e-9dc5-34cb387fa6c2 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:42.119247 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 543/1111] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:42.124321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:42.126841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:42.126841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:42.142578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:42.143741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:42.206522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 569/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:42.229502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10877511-7305-442e-9dc5-34cb387fa6c2 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:42.242060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:42.330766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10877511-7305-442e-9dc5-34cb387fa6c2 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:42.363364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:42.364240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:42.364529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:42.364805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] PATH_INFO: `/v3/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:42.366278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] RBAC: Authorizing `identity:get_role(role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:42.367701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:42.369063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 544/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:42 2022] GET /identity/v3/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:42.375569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:42.458397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:42.474452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5328a0-bfa4-466f-b2f1-1f8095b5e0b1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:42.508311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:42.509182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:42.509470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:42.509750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] PATH_INFO: `/v3/users/2a96af25e17b4f83b591d3274258ec38` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:42.522381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] RBAC: Authorizing `identity:get_user(user_id=2a96af25e17b4f83b591d3274258ec38)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:42.523828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:42.525509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 570/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:42 2022] GET /identity/v3/users/2a96af25e17b4f83b591d3274258ec38 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:42.531432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:42.606816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:42.628346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90229692-8bbe-4e7d-9a25-768b1756e9d4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:42.660700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:42.661330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:42.661612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:42.661889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:42.726243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:42.727719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:42.808533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:42.830437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 545/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:26:42.836357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:42.931042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf8963-d678-4925-bb0f-27c87ffa8bde None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:42.962276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cce3d-e6f6-4919-ac98-22b0471b0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:42.963114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cce3d-e6f6-4919-ac98-22b0471b0a8a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:42.963397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cce3d-e6f6-4919-ac98-22b0471b0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:42.963668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cce3d-e6f6-4919-ac98-22b0471b0a8a None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:42.964850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cce3d-e6f6-4919-ac98-22b0471b0a8a None admin] RBAC: Authorizing `identity:get_project(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:42.966271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cce3d-e6f6-4919-ac98-22b0471b0a8a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:42.967953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 571/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:42 2022] GET /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:42.974676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:43.070634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37446a-ef48-4d90-babc-3dc12399130c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:43.104504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:43.105180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:43.105465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:43.105742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:43.106595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] RBAC: Adding query filter params (role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf, user.id=2a96af25e17b4f83b591d3274258ec38) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:43.106911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:43.108383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98c40-3916-4620-a8d3-43f9cf7da3d8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:43.113672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 546/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:42 2022] GET /identity/v3/role_assignments?user.id=2a96af25e17b4f83b591d3274258ec38&scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:45.098833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97eb8e-a5ce-4f76-a9f8-e66592e96339 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:45.099389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97eb8e-a5ce-4f76-a9f8-e66592e96339 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:45.099389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97eb8e-a5ce-4f76-a9f8-e66592e96339 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:45.100703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 572/1118] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:45.105832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:45.106284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:45.106386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:45.123181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:45.124526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:45.158139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:45.189606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 547/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:45.211935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97eb8e-a5ce-4f76-a9f8-e66592e96339 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:45.224539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:45.313419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97eb8e-a5ce-4f76-a9f8-e66592e96339 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:45.348828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:45.350054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:45.350054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:45.350263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] PATH_INFO: `/v3/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:45.352550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] RBAC: Authorizing `identity:get_role(role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:45.354692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:45.356198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 573/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:45 2022] GET /identity/v3/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:45.362571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:45.457537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a24b-84f7-467f-8aff-c416bfdbc01e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:45.489902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:45.490754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:45.491035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:45.491308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] PATH_INFO: `/v3/users/2a96af25e17b4f83b591d3274258ec38` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:45.492488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] RBAC: Authorizing `identity:get_user(user_id=2a96af25e17b4f83b591d3274258ec38)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:45.493910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:45.495524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 548/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:45 2022] GET /identity/v3/users/2a96af25e17b4f83b591d3274258ec38 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:45.501346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:45.576349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:45.599014 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8afd-de49-4c65-98b0-dc6c878ab8fb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:45.631907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4995-2434-4b88-b284-1df4d59108d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:45.632715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4995-2434-4b88-b284-1df4d59108d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:45.632997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4995-2434-4b88-b284-1df4d59108d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:45.633269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4995-2434-4b88-b284-1df4d59108d0 None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:45.634437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4995-2434-4b88-b284-1df4d59108d0 None admin] RBAC: Authorizing `identity:get_project(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:45.635896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4995-2434-4b88-b284-1df4d59108d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:45.637569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 574/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:45 2022] GET /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:45.644766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:45.687324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:45.744006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72059d-ad66-45da-861f-ed8f7fbdaa90 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:45.779226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c860463-ee4d-4de7-8ac0-78d26ded237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:45.780142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c860463-ee4d-4de7-8ac0-78d26ded237c None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:45.780432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c860463-ee4d-4de7-8ac0-78d26ded237c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:45.780711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c860463-ee4d-4de7-8ac0-78d26ded237c None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf/users/2a96af25e17b4f83b591d3274258ec38/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:45.784178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c860463-ee4d-4de7-8ac0-78d26ded237c None admin] RBAC: Authorizing `identity:create_grant(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf, user_id=2a96af25e17b4f83b591d3274258ec38, role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:45.785984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c860463-ee4d-4de7-8ac0-78d26ded237c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:45.799429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 549/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:26:45 2022] PUT /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf/users/2a96af25e17b4f83b591d3274258ec38/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:26:47.801718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb80e56-955c-4c25-9b55-d15e3fe35706 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:47.802313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb80e56-955c-4c25-9b55-d15e3fe35706 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:47.802313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb80e56-955c-4c25-9b55-d15e3fe35706 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:47.803629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 575/1124] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:47.809151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:47.809548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:47.809714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:47.826565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:47.828763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:47.895877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 550/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:47.919919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb80e56-955c-4c25-9b55-d15e3fe35706 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:48.016480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb80e56-955c-4c25-9b55-d15e3fe35706 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:48.048321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:48.049105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:48.049386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:48.049660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] PATH_INFO: `/v3/roles/0bee4e1f42e14f7098d0816c0d16215c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:48.051114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] RBAC: Authorizing `identity:get_role(role_id=0bee4e1f42e14f7098d0816c0d16215c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:48.052496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:48.053831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 576/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:47 2022] GET /identity/v3/roles/0bee4e1f42e14f7098d0816c0d16215c => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:48.059594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:48.089244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:48.156783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66150-1f69-4f65-a609-1c7243a13201 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:48.189601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:48.190448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:48.190727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:48.190998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] PATH_INFO: `/v3/users/2a96af25e17b4f83b591d3274258ec38` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:48.192194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] RBAC: Authorizing `identity:get_user(user_id=2a96af25e17b4f83b591d3274258ec38)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:48.193617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:48.195256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 551/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:48 2022] GET /identity/v3/users/2a96af25e17b4f83b591d3274258ec38 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:48.200995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:48.216794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:48.299406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647b3a-f7ee-47c7-b279-57712a8b28b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:48.333196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:48.333830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:48.334117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:48.334398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:48.400894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:48.402350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:48.416417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:48.500988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 577/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:26:48.507175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:48.605617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:48.610117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b9f63-3e18-4aec-b705-cb7a7ce619ca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:48.645232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101c362-42a9-4dc7-aeb8-4f20174f5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:48.646088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101c362-42a9-4dc7-aeb8-4f20174f5056 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:48.646371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101c362-42a9-4dc7-aeb8-4f20174f5056 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:48.646644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101c362-42a9-4dc7-aeb8-4f20174f5056 None admin] PATH_INFO: `/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:48.647866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101c362-42a9-4dc7-aeb8-4f20174f5056 None admin] RBAC: Authorizing `identity:get_project(project_id=0b3e8e999a314b3d8f9a4fc634a6dedf)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:48.649303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101c362-42a9-4dc7-aeb8-4f20174f5056 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:48.651007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 552/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:48 2022] GET /identity/v3/projects/0b3e8e999a314b3d8f9a4fc634a6dedf => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:48.658311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:48.761584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d2a3-94c7-427a-b999-f451a1799eb6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:48.776574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:48.796400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:48.796858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:48.797140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:48.797415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:48.798234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] RBAC: Adding query filter params (role.id=0bee4e1f42e14f7098d0816c0d16215c, scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf, user.id=2a96af25e17b4f83b591d3274258ec38) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:48.798546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:48.800004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e3a4-5efd-41ad-b81a-ee589147c7af None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:48.805628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 578/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:48 2022] GET /identity/v3/role_assignments?user.id=2a96af25e17b4f83b591d3274258ec38&scope.project.id=0b3e8e999a314b3d8f9a4fc634a6dedf&role.id=0bee4e1f42e14f7098d0816c0d16215c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:50.885683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcb09-406c-4b06-983a-15964e84b1df None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:50.886214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcb09-406c-4b06-983a-15964e84b1df None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:50.886308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcb09-406c-4b06-983a-15964e84b1df None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:50.887616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 553/1131] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:50.893496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:50.893935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:50.894065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:50.910353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:50.911530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:50.975342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 579/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:50.998535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcb09-406c-4b06-983a-15964e84b1df None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:51.095490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcb09-406c-4b06-983a-15964e84b1df None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:51.127997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae99b8f-b1be-4d4f-8d4d-159cebbdee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:51.128784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae99b8f-b1be-4d4f-8d4d-159cebbdee75 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:51.129067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae99b8f-b1be-4d4f-8d4d-159cebbdee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:51.129342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae99b8f-b1be-4d4f-8d4d-159cebbdee75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:51.130638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae99b8f-b1be-4d4f-8d4d-159cebbdee75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:51.132280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae99b8f-b1be-4d4f-8d4d-159cebbdee75 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:51.133905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 554/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:51.140011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:51.235746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef48b-974d-4711-967f-62bab1b895af None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:51.244537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:51.269422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf6595-49bf-4fa2-997b-ee1c95c8529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:51.270076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6595-49bf-4fa2-997b-ee1c95c8529f None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:51.270363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6595-49bf-4fa2-997b-ee1c95c8529f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:51.270642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6595-49bf-4fa2-997b-ee1c95c8529f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:51.271341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf6595-49bf-4fa2-997b-ee1c95c8529f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:51.272803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf6595-49bf-4fa2-997b-ee1c95c8529f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:51.298316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 580/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:26:51 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:53.322275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3813e-0001-45be-bbf5-fc9c85c8fc82 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:53.322828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3813e-0001-45be-bbf5-fc9c85c8fc82 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:53.322828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3813e-0001-45be-bbf5-fc9c85c8fc82 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:53.324235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 555/1135] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:53.329995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:53.330392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:53.330559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:53.347021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:53.348230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:53.411909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 581/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:53.436897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3813e-0001-45be-bbf5-fc9c85c8fc82 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:53.472365 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:53.537825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3813e-0001-45be-bbf5-fc9c85c8fc82 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:53.569583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7da33-69df-4ad1-b65f-f8a16ce2400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:53.570355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7da33-69df-4ad1-b65f-f8a16ce2400a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:53.570638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7da33-69df-4ad1-b65f-f8a16ce2400a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:53.570913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7da33-69df-4ad1-b65f-f8a16ce2400a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:53.572087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7da33-69df-4ad1-b65f-f8a16ce2400a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:53.573560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7da33-69df-4ad1-b65f-f8a16ce2400a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:53.575111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 556/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:26:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:53.581570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:53.667065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:53.677030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e71fb-5330-4248-af0b-431f79281350 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:53.709667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817144f5-6502-49cb-bad2-78bb8f4d219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:53.710333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817144f5-6502-49cb-bad2-78bb8f4d219f None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:53.710634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817144f5-6502-49cb-bad2-78bb8f4d219f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:53.710889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817144f5-6502-49cb-bad2-78bb8f4d219f None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:53.711588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817144f5-6502-49cb-bad2-78bb8f4d219f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:53.713047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817144f5-6502-49cb-bad2-78bb8f4d219f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:53.732513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 582/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:26:53 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:26:55.814827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb6ac-4296-4c3a-b14b-fe998c519352 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:55.815278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb6ac-4296-4c3a-b14b-fe998c519352 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:55.815381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb6ac-4296-4c3a-b14b-fe998c519352 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:55.816786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 557/1139] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:55.821880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:55.822313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:55.822438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:55.839349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:55.840576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:55.904401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 583/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:26:55.928875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb6ac-4296-4c3a-b14b-fe998c519352 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:56.025870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb6ac-4296-4c3a-b14b-fe998c519352 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:56.027272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:56.059797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:56.060593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:56.060874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:56.061210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:56.070782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:56.078776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:56.079988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:56.080916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 558/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:56.085871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:56.159011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:56.182042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9c45-f612-42ca-bb57-025d592d825c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:56.215769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:56.216452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:56.216742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:56.217021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:56.217794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:56.218106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:56.219477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:56.227253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 584/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:56.232959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:56.328030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752eb5-c414-4935-b43a-8e783f57df85 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:56.359675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:56.360542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:56.360825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:56.361100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] PATH_INFO: `/v3/users/a947d8bc1b3944e99effc235495b4c52` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:56.373497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] RBAC: Authorizing `identity:get_user(user_id=a947d8bc1b3944e99effc235495b4c52)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:56.376604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:56.379464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 559/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:56 2022] GET /identity/v3/users/a947d8bc1b3944e99effc235495b4c52 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:56.385662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:56.485877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14660-e955-4464-bf4b-0adc503bfd45 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:56.519459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:56.520125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:56.520414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:56.520693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:56.528805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:56.587020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:56.588462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:56.684164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 585/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:26:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:26:56.691090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:56.711854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:56.788969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db916d7-cf0b-4725-8c13-9cf28d88a490 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:56.821881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816284-a592-47af-84e6-506f41471ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:56.822726 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816284-a592-47af-84e6-506f41471ebc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:56.823007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816284-a592-47af-84e6-506f41471ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:56.823279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816284-a592-47af-84e6-506f41471ebc None admin] PATH_INFO: `/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:56.824461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1816284-a592-47af-84e6-506f41471ebc None admin] RBAC: Authorizing `identity:get_project(project_id=0c8c41b8b047418bbd9dcc3762a97a34)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:56.825876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1816284-a592-47af-84e6-506f41471ebc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:56.827794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 560/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:56 2022] GET /identity/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:56.833897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:56.873233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:56.931932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102817a1-2e8a-4918-82e1-cd512fd51af8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:56.964834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:56.965560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:56.965850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:56.966131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:56.967003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=0c8c41b8b047418bbd9dcc3762a97a34, user.id=a947d8bc1b3944e99effc235495b4c52) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:56.967866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:56.969323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabfa29-1614-4267-ab38-28bece475786 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:56.974721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 586/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:26:56 2022] GET /identity/v3/role_assignments?user.id=a947d8bc1b3944e99effc235495b4c52&scope.project.id=0c8c41b8b047418bbd9dcc3762a97a34&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:58.992461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c866-ca2d-4b95-b478-6a09af16de60 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:58.993014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c866-ca2d-4b95-b478-6a09af16de60 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:58.993014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c866-ca2d-4b95-b478-6a09af16de60 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:58.994368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 561/1147] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:26:58.999460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:58.999923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:59.000063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:59.017368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:26:59.018538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:26:59.081731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 587/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:26:59.106648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c866-ca2d-4b95-b478-6a09af16de60 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:59.194300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:59.207850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c866-ca2d-4b95-b478-6a09af16de60 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:59.240315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:59.241092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:59.241381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:59.241660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:59.251962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:26:59.260156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:26:59.261260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:26:59.262405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 562/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:26:59.268345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:59.297647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:59.364042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491eeff-b4f3-4eff-b61e-d25e45e2733d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:59.396922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:59.397584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:59.397875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:59.398157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:59.398903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:26:59.399215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:59.400621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:59.409102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 588/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:59.415680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:59.513490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2d8a-c426-4274-ba39-f98ab79f2346 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:59.546570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:59.547438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:59.547724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:59.548032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] PATH_INFO: `/v3/users/a947d8bc1b3944e99effc235495b4c52` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:59.549228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] RBAC: Authorizing `identity:get_user(user_id=a947d8bc1b3944e99effc235495b4c52)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:59.550664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:59.552347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 563/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:26:59 2022] GET /identity/v3/users/a947d8bc1b3944e99effc235495b4c52 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:26:59.558095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:59.648145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:59.655053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb98d6-d221-4ae3-816e-c0916693abac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:59.687950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a1ee-055d-4e6a-a69f-ef1c38422c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:59.688783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a1ee-055d-4e6a-a69f-ef1c38422c61 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:59.689066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a1ee-055d-4e6a-a69f-ef1c38422c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:59.689339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a1ee-055d-4e6a-a69f-ef1c38422c61 None admin] PATH_INFO: `/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:59.690491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37a1ee-055d-4e6a-a69f-ef1c38422c61 None admin] RBAC: Authorizing `identity:get_project(project_id=0c8c41b8b047418bbd9dcc3762a97a34)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:59.691949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37a1ee-055d-4e6a-a69f-ef1c38422c61 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:59.693632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 589/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:26:59 2022] GET /identity/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:26:59.699435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:26:59.717445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:26:59.810600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5173c-2cfd-4d1b-b498-44539965742e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:26:59.847000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19041ed4-322d-47db-857e-5acdefad01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:26:59.847911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19041ed4-322d-47db-857e-5acdefad01ed None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:26:59.848199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19041ed4-322d-47db-857e-5acdefad01ed None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:26:59.848482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19041ed4-322d-47db-857e-5acdefad01ed None admin] PATH_INFO: `/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34/users/a947d8bc1b3944e99effc235495b4c52/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:26:59.850440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19041ed4-322d-47db-857e-5acdefad01ed None admin] RBAC: Authorizing `identity:create_grant(project_id=0c8c41b8b047418bbd9dcc3762a97a34, user_id=a947d8bc1b3944e99effc235495b4c52, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:26:59.851918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19041ed4-322d-47db-857e-5acdefad01ed None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:26:59.865716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 564/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:26:59 2022] PUT /identity/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34/users/a947d8bc1b3944e99effc235495b4c52/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:27:01.859804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dfd50-5293-4f23-bb93-ea5fea94d6a9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:01.860366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dfd50-5293-4f23-bb93-ea5fea94d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:01.860366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dfd50-5293-4f23-bb93-ea5fea94d6a9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:01.861756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 590/1154] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:01.866965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:01.867402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:01.867506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:01.885892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:01.887091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:01.950564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 565/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:27:01.973873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dfd50-5293-4f23-bb93-ea5fea94d6a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:02.071017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dfd50-5293-4f23-bb93-ea5fea94d6a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:02.103178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:02.103975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:02.104261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:02.104540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:02.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:27:02.121776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:27:02.122862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:27:02.124481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 591/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:27:02.129555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:02.137707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:02.229606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d0386-ef24-4874-8ca3-046971dcff8e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:02.263049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:02.263706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:02.265088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:02.265392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:02.266143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:02.266454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:02.267822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:02.275653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 566/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:02.281391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:02.305373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:02.378559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f49c6-0152-4bb0-9986-764dc908f348 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:02.410955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:02.411809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:02.412130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:02.412404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] PATH_INFO: `/v3/users/a947d8bc1b3944e99effc235495b4c52` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:02.413599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] RBAC: Authorizing `identity:get_user(user_id=a947d8bc1b3944e99effc235495b4c52)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:02.415033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:02.416677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 592/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:27:02 2022] GET /identity/v3/users/a947d8bc1b3944e99effc235495b4c52 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:02.422839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:02.487119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:02.519512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050940b-58f1-430e-8781-2445a6481678 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:02.551278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:02.551932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:02.552217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:02.552486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:02.617168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:02.618607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:02.679885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:02.712257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 567/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:27:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:27:02.718070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:02.805072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:02.815176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda34b-6ee7-44b7-af75-737e4584ac03 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:02.847155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69499440-b49a-42c9-baec-180e1621caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:02.848027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499440-b49a-42c9-baec-180e1621caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:02.848307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499440-b49a-42c9-baec-180e1621caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:02.848576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499440-b49a-42c9-baec-180e1621caf4 None admin] PATH_INFO: `/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:02.849740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499440-b49a-42c9-baec-180e1621caf4 None admin] RBAC: Authorizing `identity:get_project(project_id=0c8c41b8b047418bbd9dcc3762a97a34)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:02.851170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499440-b49a-42c9-baec-180e1621caf4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:02.852884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 593/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:27:02 2022] GET /identity/v3/projects/0c8c41b8b047418bbd9dcc3762a97a34 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:02.859930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:02.954713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7b846-aff3-4bb9-97ca-bf142a89b3c7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:02.987906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:02.988542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:02.988823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:02.989121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:02.989941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=0c8c41b8b047418bbd9dcc3762a97a34, user.id=a947d8bc1b3944e99effc235495b4c52) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:02.990254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:02.991676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd3c0f-d834-4e45-b912-67b945ead4b2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:02.997365 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 568/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:27:02 2022] GET /identity/v3/role_assignments?user.id=a947d8bc1b3944e99effc235495b4c52&scope.project.id=0c8c41b8b047418bbd9dcc3762a97a34&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:05.083089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3606e-8825-437c-838b-62f1cdcf94aa None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:05.083594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3606e-8825-437c-838b-62f1cdcf94aa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:05.083594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3606e-8825-437c-838b-62f1cdcf94aa None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:05.084959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 594/1162] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:05.090047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:05.090423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:05.090614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:05.108467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:05.109656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:05.135320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:05.177621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 569/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:27:05.200644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3606e-8825-437c-838b-62f1cdcf94aa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:05.301909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3606e-8825-437c-838b-62f1cdcf94aa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:05.339773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:05.340368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:05.340656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:05.340934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:05.368730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:05.409147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:05.410598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:05.505714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 595/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:27:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:27:05.511986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:05.607142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b98f-aede-4fb8-912c-2902787bc613 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:05.640202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:05.640988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:05.641268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:05.641535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:05.647904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:05.649334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-529ab4ba-4fa0-4b44-a7ce-6db26c79916e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:27:05.664301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:27:05.665524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:27:05.666392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 570/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:27:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:27:05.672396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:05.727670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:05.767240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03a3ff-4343-4f12-9546-c65bbaa378d7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:05.801354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:05.802003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:05.802286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:05.802562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:05.803274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:05.803583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:05.804982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fda0c-f42b-48d4-8545-76a7e13a5579 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:05.812005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 596/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 18:27:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:07.837220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c3ca-4612-46f9-9c32-3218aa306c63 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:07.837713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c3ca-4612-46f9-9c32-3218aa306c63 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:07.837832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c3ca-4612-46f9-9c32-3218aa306c63 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:07.839161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 571/1167] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:07.844528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a00b-d05e-4786-861e-78a470497397 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:07.844950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a00b-d05e-4786-861e-78a470497397 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:07.845099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a00b-d05e-4786-861e-78a470497397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:07.861885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8353a00b-d05e-4786-861e-78a470497397 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:07.863071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8353a00b-d05e-4786-861e-78a470497397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:07.930452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 597/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:27:07.953447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2c3ca-4612-46f9-9c32-3218aa306c63 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:07.977552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:08.054235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2c3ca-4612-46f9-9c32-3218aa306c63 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:08.086735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120da4e6-9134-4df7-9c0f-6a28bb076502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:08.087379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120da4e6-9134-4df7-9c0f-6a28bb076502 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:08.087664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120da4e6-9134-4df7-9c0f-6a28bb076502 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:08.087965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120da4e6-9134-4df7-9c0f-6a28bb076502 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:08.088709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120da4e6-9134-4df7-9c0f-6a28bb076502 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:08.090062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120da4e6-9134-4df7-9c0f-6a28bb076502 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:08.103999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 572/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Jun 22 18:27:07 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:27:10.122477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83835-efd6-4c9b-b2b9-596d6bc1d301 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:10.122996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83835-efd6-4c9b-b2b9-596d6bc1d301 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:10.122996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83835-efd6-4c9b-b2b9-596d6bc1d301 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:10.124430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 598/1170] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:10.129537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:10.129912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:10.130095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:10.147138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:10.148327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:10.212698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 573/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:27:10.236318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83835-efd6-4c9b-b2b9-596d6bc1d301 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:10.288462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:10.335141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83835-efd6-4c9b-b2b9-596d6bc1d301 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:10.368651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35926a2-d9ac-426f-8c84-5eac79d080c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:10.369501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35926a2-d9ac-426f-8c84-5eac79d080c4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:10.369780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35926a2-d9ac-426f-8c84-5eac79d080c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:10.370047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35926a2-d9ac-426f-8c84-5eac79d080c4 None admin] PATH_INFO: `/v3/domains/f1b673f3ac7744a9b448cbe7445c0a39` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:10.380924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35926a2-d9ac-426f-8c84-5eac79d080c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f1b673f3ac7744a9b448cbe7445c0a39)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:10.382564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35926a2-d9ac-426f-8c84-5eac79d080c4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:10.384231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 599/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jun 22 18:27:10 2022] GET /identity/v3/domains/f1b673f3ac7744a9b448cbe7445c0a39 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:10.390093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:10.403736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:10.489003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6c4e1-19bf-4cbf-aa96-ea4cd4d23b47 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:10.522518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17befd-48ac-4067-92ca-06a16f4a1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:10.523170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17befd-48ac-4067-92ca-06a16f4a1326 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:10.523453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17befd-48ac-4067-92ca-06a16f4a1326 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:10.523726 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17befd-48ac-4067-92ca-06a16f4a1326 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:10.524469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17befd-48ac-4067-92ca-06a16f4a1326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:10.525896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17befd-48ac-4067-92ca-06a16f4a1326 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:10.550477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 574/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:27:10 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:27:12.605900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115682e-04bd-44f7-b458-9225a8010fa2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:12.606432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115682e-04bd-44f7-b458-9225a8010fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:12.606432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115682e-04bd-44f7-b458-9225a8010fa2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:12.607828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 600/1174] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:12.613124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:12.613528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:12.613675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:12.630455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:12.631891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:12.687779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:12.697304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 575/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:27:12.721873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115682e-04bd-44f7-b458-9225a8010fa2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:12.821620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115682e-04bd-44f7-b458-9225a8010fa2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:12.834677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:12.855357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357e3e7-9e2b-4c86-b5ea-dd560246864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:12.856309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e3e7-9e2b-4c86-b5ea-dd560246864d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:12.856545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e3e7-9e2b-4c86-b5ea-dd560246864d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:12.856822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e3e7-9e2b-4c86-b5ea-dd560246864d None admin] PATH_INFO: `/v3/domains/f1b673f3ac7744a9b448cbe7445c0a39` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:12.858236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357e3e7-9e2b-4c86-b5ea-dd560246864d None admin] RBAC: Authorizing `identity:get_domain(domain_id=f1b673f3ac7744a9b448cbe7445c0a39)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:12.859668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357e3e7-9e2b-4c86-b5ea-dd560246864d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:12.861332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 601/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jun 22 18:27:12 2022] GET /identity/v3/domains/f1b673f3ac7744a9b448cbe7445c0a39 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:12.867051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:12.963688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea996c6a-773f-4d29-b323-5c6f1bfa0c93 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:12.996924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dda8e-5225-404a-bc53-55eae74424e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:12.997577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dda8e-5225-404a-bc53-55eae74424e6 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:12.998404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dda8e-5225-404a-bc53-55eae74424e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:12.998691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dda8e-5225-404a-bc53-55eae74424e6 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:12.999398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dda8e-5225-404a-bc53-55eae74424e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:13.000855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dda8e-5225-404a-bc53-55eae74424e6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:13.022115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 576/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:27:12 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:27:15.113300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ac6a-aead-4a13-bb04-5c66a3aa3184 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:15.113854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ac6a-aead-4a13-bb04-5c66a3aa3184 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:15.113854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ac6a-aead-4a13-bb04-5c66a3aa3184 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:15.115145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 602/1178] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:15.120457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:15.120882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:15.121022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:15.139605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:15.140835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:15.192398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:15.214335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 577/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:27:15.238091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ac6a-aead-4a13-bb04-5c66a3aa3184 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:15.334921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ac6a-aead-4a13-bb04-5c66a3aa3184 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:15.366944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:15.367650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:15.367970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:15.368248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:15.377833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:27:15.385512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:27:15.386681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:27:15.388033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 603/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:27:15.393020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:15.511253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c261-e5ca-465d-b55f-685f1998af72 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:15.544431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:15.545117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:15.545380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:15.545658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:15.546405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:15.546717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:15.548110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:15.555810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 578/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:27:15.561553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:15.602638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:15.660012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c05b61-8552-49b0-ad45-be36ecba7d1b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:15.692207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:15.693066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:15.693356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:15.693634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] PATH_INFO: `/v3/users/a7b02133c71b43da95c298c94f9cbeee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:15.707110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7b02133c71b43da95c298c94f9cbeee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:15.708590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:15.710270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 604/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:27:15 2022] GET /identity/v3/users/a7b02133c71b43da95c298c94f9cbeee => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:15.716037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:15.758627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:15.822139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e5769-6958-4b90-b85f-b019abf0b4e0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:15.854593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:15.855224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:15.855508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:15.855783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:15.924114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:15.925475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:15.965713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:16.021344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 579/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:27:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:27:16.027149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:16.121677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:16.126170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795188f-783a-468e-a194-3d9c3ad65cf7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:16.162538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e81b1-2f29-4c2c-a330-5eb51e6304c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:16.163381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e81b1-2f29-4c2c-a330-5eb51e6304c6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:16.163662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e81b1-2f29-4c2c-a330-5eb51e6304c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:16.163965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e81b1-2f29-4c2c-a330-5eb51e6304c6 None admin] PATH_INFO: `/v3/projects/09e8f04e78534ee1b77cd5c892b4737c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:16.165131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e81b1-2f29-4c2c-a330-5eb51e6304c6 None admin] RBAC: Authorizing `identity:get_project(project_id=09e8f04e78534ee1b77cd5c892b4737c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:16.166560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e81b1-2f29-4c2c-a330-5eb51e6304c6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:16.168276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 605/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:27:16 2022] GET /identity/v3/projects/09e8f04e78534ee1b77cd5c892b4737c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:16.175132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:16.271002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0ade-80f4-4b70-813b-23e057f3fb10 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:16.304626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:16.305266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:16.305551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:16.305830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:16.306655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=09e8f04e78534ee1b77cd5c892b4737c, user.id=a7b02133c71b43da95c298c94f9cbeee) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:16.306974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:16.308442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499f30e-cb30-473a-a31e-5b79fad9e848 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:16.314034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 580/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:27:16 2022] GET /identity/v3/role_assignments?user.id=a7b02133c71b43da95c298c94f9cbeee&scope.project.id=09e8f04e78534ee1b77cd5c892b4737c&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:18.311734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc1339-f393-4d1d-b099-b1f03593e9dc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:18.312322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc1339-f393-4d1d-b099-b1f03593e9dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:18.312460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc1339-f393-4d1d-b099-b1f03593e9dc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:18.313829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 606/1186] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:27:18.318930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:18.319319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:18.319491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:18.330931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:18.336921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:18.338091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:18.402032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 581/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:27:18.425081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc1339-f393-4d1d-b099-b1f03593e9dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:18.523795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc1339-f393-4d1d-b099-b1f03593e9dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:18.556393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:18.557167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:18.557449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:18.557722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:18.567530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:27:18.575022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:27:18.576664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:27:18.577710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 607/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:27:18.582801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:18.678275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385902-8041-44b1-a385-ba0691b6757e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:18.711972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:18.712622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:18.712906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:18.713181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:18.713925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:18.714236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:18.715598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:18.718187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:18.724758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 582/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:18.730396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:18.760898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:18.841197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afb97-f938-4ce8-9587-52ed9ee00963 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:18.878668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:18.879542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:18.879822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:18.880129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] PATH_INFO: `/v3/users/a7b02133c71b43da95c298c94f9cbeee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:18.881579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] RBAC: Authorizing `identity:get_user(user_id=a7b02133c71b43da95c298c94f9cbeee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:18.883009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:18.884742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 608/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:27:18 2022] GET /identity/v3/users/a7b02133c71b43da95c298c94f9cbeee => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:18.892650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:18.992489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e20b8-bb07-4644-9c5a-bd7365c6c5ac None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:19.025426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70279cac-403a-473e-940e-ef3905a441f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:19.026273 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70279cac-403a-473e-940e-ef3905a441f4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:19.026556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70279cac-403a-473e-940e-ef3905a441f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:19.026830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70279cac-403a-473e-940e-ef3905a441f4 None admin] PATH_INFO: `/v3/projects/09e8f04e78534ee1b77cd5c892b4737c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:19.028027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70279cac-403a-473e-940e-ef3905a441f4 None admin] RBAC: Authorizing `identity:get_project(project_id=09e8f04e78534ee1b77cd5c892b4737c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:19.029474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70279cac-403a-473e-940e-ef3905a441f4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:19.031173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 583/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:27:18 2022] GET /identity/v3/projects/09e8f04e78534ee1b77cd5c892b4737c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:19.037046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:19.129062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:19.136478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005168-e64a-4a6a-99e1-62885dd01b25 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:19.168462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05645f-be02-4704-98f7-e6fd2892d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:19.169919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05645f-be02-4704-98f7-e6fd2892d3c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:19.170200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05645f-be02-4704-98f7-e6fd2892d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:19.170474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05645f-be02-4704-98f7-e6fd2892d3c0 None admin] PATH_INFO: `/v3/projects/09e8f04e78534ee1b77cd5c892b4737c/users/a7b02133c71b43da95c298c94f9cbeee/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:19.172423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05645f-be02-4704-98f7-e6fd2892d3c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=09e8f04e78534ee1b77cd5c892b4737c, user_id=a7b02133c71b43da95c298c94f9cbeee, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:19.173848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05645f-be02-4704-98f7-e6fd2892d3c0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:19.186735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 609/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:27:19 2022] PUT /identity/v3/projects/09e8f04e78534ee1b77cd5c892b4737c/users/a7b02133c71b43da95c298c94f9cbeee/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:27:21.206311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c72b73-93e1-4f40-834c-41f2d14941b6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:21.206827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c72b73-93e1-4f40-834c-41f2d14941b6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:21.206827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c72b73-93e1-4f40-834c-41f2d14941b6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:21.208176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 584/1193] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:27:21.213248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:21.213648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:21.213807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:21.230606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:27:21.232440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:27:21.296550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 610/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:27:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 18:27:21.320030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c72b73-93e1-4f40-834c-41f2d14941b6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:21.385722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:21.422332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c72b73-93e1-4f40-834c-41f2d14941b6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:21.455494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:21.456296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:21.456629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:21.456858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:21.467864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:27:21.475444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:27:21.476579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:27:21.477789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 585/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:27:21.482703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:21.563395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:21.580931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fde23-462b-4e2e-9ce3-f0cbb7f3dcaf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:21.613958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:21.614618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:21.614917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:21.615200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:21.616047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:21.616365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:21.617741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:21.626094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 611/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:21.631939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:21.727565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b48a-8f73-4546-8dff-241a8eee8263 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:21.752604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:21.761672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:21.762555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:21.763425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:21.763699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] PATH_INFO: `/v3/users/a7b02133c71b43da95c298c94f9cbeee` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:21.764929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7b02133c71b43da95c298c94f9cbeee)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:21.766352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:21.768021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 586/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 18:27:21 2022] GET /identity/v3/users/a7b02133c71b43da95c298c94f9cbeee => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:21.773611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:21.868446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc7a80-6b45-43c9-808d-5ccb6c7b4ca3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:21.901699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:21.902332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:21.902614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:21.902890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:21.917244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:21.969278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:21.970738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:22.064755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 612/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:27:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:27:22.070523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:22.166499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51090-4504-4df0-925b-fde97c9d3af7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:22.199135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712327e4-badc-4447-960b-f41f182c433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:22.200000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712327e4-badc-4447-960b-f41f182c433e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:22.200308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712327e4-badc-4447-960b-f41f182c433e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:22.200843 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712327e4-badc-4447-960b-f41f182c433e None admin] PATH_INFO: `/v3/projects/09e8f04e78534ee1b77cd5c892b4737c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:22.201733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712327e4-badc-4447-960b-f41f182c433e None admin] RBAC: Authorizing `identity:get_project(project_id=09e8f04e78534ee1b77cd5c892b4737c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:22.203150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712327e4-badc-4447-960b-f41f182c433e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:22.204834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 587/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 18:27:22 2022] GET /identity/v3/projects/09e8f04e78534ee1b77cd5c892b4737c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:22.210695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:27:22.257003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:22.309278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175b50-359b-4315-95a4-c22b902687f1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:27:22.343674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:27:22.344289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:27:22.344577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:27:22.344854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:27:22.345683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=09e8f04e78534ee1b77cd5c892b4737c, user.id=a7b02133c71b43da95c298c94f9cbeee) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:27:22.346000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:27:22.347440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a10174-7d8a-445b-b913-59c09f06fdb3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:27:22.353126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 613/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:27:22 2022] GET /identity/v3/role_assignments?user.id=a7b02133c71b43da95c298c94f9cbeee&scope.project.id=09e8f04e78534ee1b77cd5c892b4737c&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:27:32.195244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=69 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:27:32.350543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=45 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:17.929692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e435276-f793-4672-93ca-b2225d70b35c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:17.930280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e435276-f793-4672-93ca-b2225d70b35c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:17.930280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e435276-f793-4672-93ca-b2225d70b35c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:17.931698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 588/1201] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:17.938082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:17.938637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:17.938950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:17.963994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:17.965314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:18.052001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 614/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:18.078482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e435276-f793-4672-93ca-b2225d70b35c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:18.215414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e435276-f793-4672-93ca-b2225d70b35c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:18.256379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:18.257199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:18.257483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:18.257753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:18.273334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:18.274864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:18.294761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:18.300354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:18.301335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:18.301335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:18.301335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:18.301335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:18.301335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 589/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:18.304108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:18.441471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f9266-ec5b-4298-9557-4b219c49ded3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:18.486594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:18.493733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:18.494969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:18.495407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:18.495693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:18.496467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:18.500425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:18.502704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8a254-969f-4997-822e-35acddf46b51 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:18.519890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 615/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:18.522747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:18.596187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:18.654160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503cf1-a98d-4917-b531-d72923752901 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:18.698267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b6a3c-1d18-4e5e-ad26-329de056b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:18.698986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b6a3c-1d18-4e5e-ad26-329de056b26d None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:18.699279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b6a3c-1d18-4e5e-ad26-329de056b26d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:18.699560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b6a3c-1d18-4e5e-ad26-329de056b26d None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:18.700306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b6a3c-1d18-4e5e-ad26-329de056b26d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:18.701749 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b6a3c-1d18-4e5e-ad26-329de056b26d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:18.726883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 590/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 18:28:18 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:28:21.201521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478f7cb-fbdc-4c0a-a105-4b5ad46693f4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:21.202040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478f7cb-fbdc-4c0a-a105-4b5ad46693f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:21.202040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478f7cb-fbdc-4c0a-a105-4b5ad46693f4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:21.203354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 616/1206] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:21.208851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:21.209300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:21.209389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:21.227894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:21.229135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:21.301640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 591/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:21.325810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478f7cb-fbdc-4c0a-a105-4b5ad46693f4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:21.444417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478f7cb-fbdc-4c0a-a105-4b5ad46693f4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:21.484426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:21.485075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:21.485414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:21.485634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:21.497585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:28:21.505710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:21.509512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:21.510458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 617/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:28:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:21.513390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:21.556373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:21.626486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282c0f-261b-4ea1-a0af-dc3ebe0c7a09 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:21.668490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:21.669173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:21.669462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:21.669743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:21.670541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:21.670813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:21.672346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:21.681700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 592/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:28:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:21.693029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:21.754170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:21.805657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daad36-d6a3-4137-a812-322c9c24faaf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:21.845163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:21.845986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:21.846274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:21.846557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:21.859344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:21.861620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:21.881422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:21.882479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:21.883450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:21.883450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:21.883450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:21.883450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:21.883450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 618/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:21.889193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:22.015057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:22.018100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737277d9-c973-4af4-9cc0-ef53a476d189 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:22.055738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:22.056476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:22.056764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:22.057047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:22.057839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:22.058169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:22.059593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:22.073291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 593/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:22.079421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:22.192544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8a3e-c4ee-4240-9f33-ffc4f2c3ecec None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:22.194282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:22.232179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:22.233135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:22.233396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:22.233618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:22.241456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:22.242952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:28:22.260022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:22.261643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:22.263100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 619/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:22.269301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:22.404796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb603f-ac88-4302-ade4-521bd71ebc9c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:22.443304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:22.443966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:22.444256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:22.444543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:22.445430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:22.445746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:22.447735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:22.468380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 594/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 18:28:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:22.474017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:22.586580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5aec-6fe1-4f07-8d2e-22577f1cb7bc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:22.624262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:22.624913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:22.625248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:22.625612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:22.661134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:22.705249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:22.706822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:22.821271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 620/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:28:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:28:22.827062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:22.848278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:22.938943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189baff-48c2-40fd-a574-c15020721edc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:22.976862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:22.977696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:22.978065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:22.978852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:22.989983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:22.991576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:23.013212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:23.016324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:23.017263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:23.017263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:23.017263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:23.017263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:23.017263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 595/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:23.020420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:23.088771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:23.135261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc5191-0bb8-460d-af2c-4522231f3233 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:23.180510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:23.181884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:23.182429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:23.182762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:23.183615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:23.184071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:23.185649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:23.199584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 621/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:23.206442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:23.285139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:23.324360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a28f-b3dd-4018-95bd-a06f99546b3c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:23.370922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:23.371722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:23.372043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:23.372325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:23.380234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:23.381714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:28:23.397209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:23.398346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:23.399500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:23.403520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 596/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:23.404491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:23.520270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c54ccc-b579-4196-9b9d-200dd3bf58da None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:23.546736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:23.563647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:23.564640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:23.565247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:23.565816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:23.567231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:23.567935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:23.570070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4e19e-39d2-4690-aa1f-ba597c15b70d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:23.588724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 622/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:23.595224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:23.709059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879122-a2b7-406a-9d2d-1bf15d58ac04 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:23.743100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:23.755596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:23.756286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:23.756569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:23.756846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:23.757682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=9f3f2c10f9fc444aba93f0d999359662) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:23.757994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:23.759677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e9af-3f20-493f-97af-48bc0f9ab5c4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:23.766018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 597/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:28:23 2022] GET /identity/v3/role_assignments?user.id=9f3f2c10f9fc444aba93f0d999359662&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:25.825438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929af13-87d5-47e1-b48f-f1b05e728bdb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:25.825958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929af13-87d5-47e1-b48f-f1b05e728bdb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:25.826162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929af13-87d5-47e1-b48f-f1b05e728bdb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:25.828696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 623/1220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:25.833975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:25.834420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:25.834563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:25.852135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:25.854228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:25.930699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 598/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:25.954845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929af13-87d5-47e1-b48f-f1b05e728bdb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:26.073896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929af13-87d5-47e1-b48f-f1b05e728bdb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:26.115543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:26.116370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:26.116673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:26.116994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:26.128450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:28:26.137249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:26.138395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:26.139236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 624/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:26.144787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:26.265010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a81a9-9655-4fc8-9a42-a42f87c0e354 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:26.289476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:26.302991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:26.303771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:26.304084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:26.304360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:26.305275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:26.305588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:26.307929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:26.316910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 599/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:26.322878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:26.369624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:26.428732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b870a0-7461-4734-b3c8-cada8ef7a992 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:26.463146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:26.463973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:26.464267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:26.464544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:26.476227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:26.477708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:26.499064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:26.500508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:26.501789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:26.501789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:26.501789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:26.501789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:26.501789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 625/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:28:26.506802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:26.609909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf548-646a-4168-8164-d2424d96b476 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:26.647281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:26.647942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:26.648391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:26.648786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:26.649993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:26.650444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:26.652244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:26.667410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 600/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:26.673163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:26.772028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:26.780088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401a2c-637f-4da8-83b6-d0113f113434 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:26.814827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:26.815630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:26.815948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:26.816227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:26.823856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:26.825327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:28:26.840153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:26.841708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:26.842666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 626/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:26.848254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:26.901693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:26.962146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39078e-4a29-4d7b-8c56-800271ff58e0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:26.998022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:26.998674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:26.998958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:26.999230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:27.000100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:27.000415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:27.001875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:27.021138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 601/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 18:28:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:27.027343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:27.144256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564dd8-f43d-4835-8bfa-1329e9cb7de3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:27.182353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:27.183110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:27.183412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:27.183730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:27.197213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:27.198946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:27.220428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:27.221456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:27.222374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:27.222374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:27.222374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:27.222374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:27.222374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 627/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:27.229367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:27.339012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbc38f-c580-472c-9e42-537ea49c61bc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:27.341555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:27.380198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:27.380905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:27.381264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:27.381583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:27.382317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:27.382629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:27.384764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:27.396974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 602/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:27.404223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:27.415967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:27.526731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a8199-22d9-41a1-9b26-cd2ee3907d20 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:27.573940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:27.574736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:27.575027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:27.575318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:27.582033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:27.583503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:28:27.600690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:27.601704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:27.602646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:27.610103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 628/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:27.610250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:27.732504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18dc33-8cf1-46bc-9096-0d705ec91e38 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:27.772837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:27.773501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:27.773834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:27.774120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:27.775577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:27.775910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:27.777432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a7f4-b112-4804-bcdc-8d12199ad192 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:27.789730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 603/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:27.797029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:27.872506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:27.909815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72e02-97e1-4be8-b3d3-9fa768febb7e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:27.944389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2e3d6-c506-4c77-a96f-61293587f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:27.945273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2e3d6-c506-4c77-a96f-61293587f7ff None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:27.945556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2e3d6-c506-4c77-a96f-61293587f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:27.945831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2e3d6-c506-4c77-a96f-61293587f7ff None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/9f3f2c10f9fc444aba93f0d999359662/roles/ce04786f472a44fbb6ba863612646967` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:27.961821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2e3d6-c506-4c77-a96f-61293587f7ff None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=9f3f2c10f9fc444aba93f0d999359662, role_id=ce04786f472a44fbb6ba863612646967)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:27.963556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2e3d6-c506-4c77-a96f-61293587f7ff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:27.977097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 629/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:28:27 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/9f3f2c10f9fc444aba93f0d999359662/roles/ce04786f472a44fbb6ba863612646967 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:28:30.244456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64412657-39e0-476b-a686-1b9c3677edae None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:30.244956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64412657-39e0-476b-a686-1b9c3677edae None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:30.244956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64412657-39e0-476b-a686-1b9c3677edae None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:30.246307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 604/1233] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:30.251826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:30.252395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:30.252488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:30.269584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:30.270848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:30.347056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 630/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:30.374509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64412657-39e0-476b-a686-1b9c3677edae None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:30.403307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:30.499734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64412657-39e0-476b-a686-1b9c3677edae None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:30.548789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:30.549151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:30.549434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:30.549712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:30.560213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:28:30.569104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:30.570280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:30.571351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 605/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 18:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:30.579761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:30.631716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:30.695693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e953-21f4-4063-94e7-d9d547c26612 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:30.737499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:30.738172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:30.738460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:30.738737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:30.739491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:30.739803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:30.741823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:30.751460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 631/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 18:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:30.758474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:30.869782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:30.890234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25912-efd3-4c65-976a-47f468298daf None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:30.935662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:30.936578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:30.936899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:30.937221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:30.951343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:30.953278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:30.975805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:30.976998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:30.978126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:30.978126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:30.978126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:30.978126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:30.978126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 606/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:30.984248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:31.110742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159ecf3-5082-43a8-be88-804e4432b1b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:31.121364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:31.154634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:31.155430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:31.155763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:31.156068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:31.156831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:31.157145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:31.158618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:31.174135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 632/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:31.182265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:31.298007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd603d-a9af-44bd-9996-16ea3bd4b07a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:31.335621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:31.336455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:31.336740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:31.337022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:31.340562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:31.350495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:31.352013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:28:31.369507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:31.370801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:31.371786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:31.375997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 607/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:31.378155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:31.499628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9d37-3f67-4685-b624-622b531edf1f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:31.546357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:31.547225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:31.547634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:31.548038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:31.549017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:31.549456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:31.551394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:31.571733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 633/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 18:28:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:31.578200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:31.694761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf6120-73a8-4d75-af33-9b21cccba406 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:31.732440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:31.733094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:31.733382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:31.733662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:31.805422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:31.813400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:31.814863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:31.928427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 608/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:28:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 18:28:31.934937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:31.969715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:32.056966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa511-35eb-4c5f-af14-129c48a7353d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:32.101804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:32.103312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:32.103603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:32.103915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:32.114186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:32.115703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:32.135630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:32.136731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:32.137781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:32.137781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:32.137781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:32.137781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:32.137781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 634/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 18:28:32.143556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:32.252646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:32.261158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee82daf-1833-4b95-9664-aaafde2ecba6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:32.300178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:32.300837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:32.301113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:32.301386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:32.302107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:32.302421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:32.304155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:32.317285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 609/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:32.323669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:32.411308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:32.439954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d6bcb-6294-44c6-b4f3-ddad9fae467c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:32.481180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:32.482100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:32.482390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:32.482709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:32.491539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:32.494615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:28:32.513006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:32.514050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:32.515027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 635/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:32.520410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:32.632945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ce30-6232-46dc-bbf5-9d260c0814b9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:32.675743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:32.676421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:32.676704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:32.676981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:32.677763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:32.678070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:32.679552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28954a4a-437b-4857-b70f-a20ac792fe9a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:32.693166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 610/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:32.699751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:32.822461 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58000da9-36b3-4438-b748-7cdabc93b5e3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:32.858856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:32.859568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:32.859848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:32.860142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:32.860985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] RBAC: Adding query filter params (role.id=ce04786f472a44fbb6ba863612646967, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=9f3f2c10f9fc444aba93f0d999359662) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:32.861331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:32.862800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bd372-040c-4066-a55a-bc45bd72c4a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:32.871645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 636/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:28:32 2022] GET /identity/v3/role_assignments?user.id=9f3f2c10f9fc444aba93f0d999359662&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=ce04786f472a44fbb6ba863612646967 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:35.028123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70b91-5083-492d-bcff-6812ee5abed4 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:35.028638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70b91-5083-492d-bcff-6812ee5abed4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:35.028750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70b91-5083-492d-bcff-6812ee5abed4 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:35.030110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 611/1247] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:35.035420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:35.036026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:35.036026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:35.041286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:35.057480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:35.059083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:35.137094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 637/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:35.161069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70b91-5083-492d-bcff-6812ee5abed4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:35.183347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:35.277224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70b91-5083-492d-bcff-6812ee5abed4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:35.315358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:35.316114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:35.316404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:35.316679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:35.329284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:28:35.337870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:35.339192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:35.340183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 612/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:35.345827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:35.460958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff60c37-267d-4ab8-bbf5-ac01fa1f53ad None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:35.499287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:35.505977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:35.507327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:35.507665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:35.508098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:35.509148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:35.509534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:35.511529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:35.525370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 638/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:35.534262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:35.630192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:35.657849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062809b-5ecd-47c6-89c8-1fd3074137c0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:35.695217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:35.696197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:35.696491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:35.696770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:35.708378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:35.710041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:35.729494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:35.730637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:35.731717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:35.731717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:35.731717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:35.731717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:35.731717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 613/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:35.736449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:35.856728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16707-3e3b-4c9c-a183-67426c7c0704 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:35.895394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:35.896043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:35.896384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:35.896602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:35.897386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:35.897698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:35.899093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:35.911670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 639/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:35.917435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:36.037939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8ba6e-317b-4013-8e17-dd6d9844088f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:36.074041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:36.083450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:36.084427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:36.084714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:36.085065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:36.093971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:36.095538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:28:36.113055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:36.114279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:36.115452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 614/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:36.121445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:36.186749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:36.236326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5cf2-4f1f-4732-b7ff-fd52fdeeadff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:36.280837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:36.281507 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:36.281812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:36.282078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:36.282959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:36.283253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:36.284740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:36.304158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 640/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 18:28:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:36.310606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:36.419887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf8c80-635f-45bd-9a89-34c8d9041bf2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:36.455271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:36.455920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:36.456169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:36.456458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:36.527748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:36.543615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:36.545135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:36.654432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 615/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:28:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:28:36.660295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:36.767302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be45a-932c-4de3-aec9-70ca35349295 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:36.786311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:36.814227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:36.815299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:36.815768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:36.816221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:36.827532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:36.829228 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:36.849402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:36.850556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:36.851679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:36.851679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:36.851679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:36.851679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:36.851679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 641/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:36.856897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:36.955702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:36.968704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef1ed-1f48-498e-a054-d0331dd6952b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:37.008138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:37.009775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:37.010191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:37.010593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:37.011522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:37.012003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:37.013663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:37.028546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 616/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:37.034870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:37.141911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb3d03-5b3a-488b-98e5-56f953975ad1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:37.179526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:37.181044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:37.181501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:37.181852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:37.189046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:37.190646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:28:37.206073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:37.207288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:37.208804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 642/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:37.213466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:37.322192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32eb9dd-16ca-4ac3-8893-e92dd81114a5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:37.357663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:37.358316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:37.358603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:37.358879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:37.359667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:37.360007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:37.361438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc4cf1-3b55-47ab-8ada-eab7910b7537 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:37.373518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 617/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:37.380067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:37.408042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:37.493173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbea20-ad4f-44c9-b718-89dd52181bb6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:37.532775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:37.533584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:37.534022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:37.534386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:37.535494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=9f3f2c10f9fc444aba93f0d999359662) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:37.535900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:37.537607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c215b7-14f0-40e5-b30f-0353f9488598 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:37.545358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 643/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:28:37 2022] GET /identity/v3/role_assignments?user.id=9f3f2c10f9fc444aba93f0d999359662&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:39.619690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f074-0282-4d11-844a-eaa967f02ade None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:39.620262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f074-0282-4d11-844a-eaa967f02ade None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:39.620354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f074-0282-4d11-844a-eaa967f02ade None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:39.621754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 618/1261] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:39.626884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:39.627281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:39.627453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:39.644277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:39.645473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:39.709606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 644/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:39.733608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f074-0282-4d11-844a-eaa967f02ade None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:39.744414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:39.832385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f074-0282-4d11-844a-eaa967f02ade None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:39.864502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:39.865279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:39.865560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:39.865830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:39.875971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:28:39.884718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:39.886406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:39.887690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 619/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:39.892201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:39.910805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:39.989299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dc714-b13d-418b-a98c-b8030d33d9a3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.023603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.025297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.025581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.025857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.026604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:40.026916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.028336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:40.036138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 645/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:40.041958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:40.109423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:40.142792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a826-dfe1-4bdb-a2fa-232384e3d6bb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.175098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.175898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.176180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.176453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.187048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.188505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:40.205299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:40.206320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:40.207586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:40.207586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:40.207586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:40.207586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:40.207586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 620/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:40.212492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:40.290938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:40.310290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7a73-db2a-4e83-b5b5-d3a59ef42ffe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.342995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.343652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.343971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.344256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.344983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:40.345296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.346664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:40.358184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 646/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:40.363814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:40.460787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71270-70c1-4f24-bd66-0b2b72987712 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.480453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:40.496305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.497101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.497385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.497663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.506071 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.507604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:28:40.522602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:40.524582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:40.525825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 621/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:40.529852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:40.635370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1c2f-7ca6-48c6-adc4-b7decfe41251 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.668298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.668943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.669226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.669499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.670347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:40.670655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.672092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:40.680917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:40.689739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 647/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 18:28:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:40.695332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:40.793384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91850-4679-4127-971c-cade8ac6a487 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.825578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.826352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.826637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.826918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.837072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.838515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:40.855320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:40.856377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:40.857495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:40.857495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:40.857495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:40.857495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:40.857495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 622/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:40.862178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:40.958438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf88698-cdcc-4978-82a7-2734f36a24da None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:40.991384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:40.992061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:40.992350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:40.993179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:40.993995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:40.994311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:40.995684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:41.006727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 648/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:41.012212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:41.043732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:41.109218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6860f-798c-4992-b77d-a907bbb49593 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:41.142145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:41.142929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:41.143215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:41.143493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:41.150051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:41.151481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:28:41.165336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:41.166446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:41.167509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 623/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:41.172226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:41.228994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:41.269395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8912804-28b3-4e5b-94ef-7e301c0b8b48 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:41.301236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:41.301817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:41.302102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:41.302380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:41.303158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:41.303468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:41.304920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fa0b4-69c6-4d58-894b-2ae78d5b5236 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:41.316547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 649/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:41.322933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:41.410457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:41.419537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3aee-deef-4a77-afdf-edad4a6ad2ca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:41.452120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e06513-3af3-4bff-8070-178a4fb3f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:41.452991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06513-3af3-4bff-8070-178a4fb3f841 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:41.453273 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06513-3af3-4bff-8070-178a4fb3f841 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:41.453546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06513-3af3-4bff-8070-178a4fb3f841 None admin] PATH_INFO: `/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/9f3f2c10f9fc444aba93f0d999359662/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:41.455457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e06513-3af3-4bff-8070-178a4fb3f841 None admin] RBAC: Authorizing `identity:create_grant(project_id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user_id=9f3f2c10f9fc444aba93f0d999359662, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:41.456914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e06513-3af3-4bff-8070-178a4fb3f841 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:41.469691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 624/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 18:28:41 2022] PUT /identity/v3/projects/de94e3ce9f9c4bbe8dc9c99f79c4bcab/users/9f3f2c10f9fc444aba93f0d999359662/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:28:43.524307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a244a3-8e40-41ea-bdcc-f5c29cdcc9ee None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:43.524845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a244a3-8e40-41ea-bdcc-f5c29cdcc9ee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:43.525007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a244a3-8e40-41ea-bdcc-f5c29cdcc9ee None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:43.526869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 650/1274] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:43.532803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:43.533198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:43.533477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:43.553557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:43.554786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:43.624056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 625/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:43.649574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a244a3-8e40-41ea-bdcc-f5c29cdcc9ee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:43.745909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a244a3-8e40-41ea-bdcc-f5c29cdcc9ee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:43.763472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:43.785945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:43.786673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:43.786956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:43.787232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:43.797222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 18:28:43.804693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:43.810321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:43.811376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 651/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 18:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:43.812315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:43.889840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:43.908586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689e1c8-b7d7-4f1b-9ef2-e1eafa0cd13e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:43.940966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:43.941618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:43.941901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:43.942174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:43.942917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:43.943224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:43.944598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:43.953142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 626/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 18:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:43.958738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:44.054966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898444-6b84-4ef5-b313-c8042ae398e8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:44.088654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:44.089432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:44.089719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:44.089996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:44.100143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:44.101592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:44.119060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:44.120180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:44.121155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:44.121155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:44.121155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:44.121155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:44.121155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 652/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:44.125908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:44.224207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6035181-3929-4255-bdbc-06c69f0d28d3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:44.256718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:44.257363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:44.257643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:44.258423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:44.259136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:44.259439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:44.260828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:44.271952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 627/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:44.278692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:44.309054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:44.377628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61207-d7a6-4154-867f-1821140593a9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:44.411310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:44.412121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:44.412413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:44.412690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:44.420319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:44.421759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 18:28:44.435996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:44.437101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:44.438339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 653/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:44.442909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:44.447206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:44.549620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efbbc-3b53-420c-a82a-55d61d6441e9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:44.582370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:44.582963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:44.583244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:44.583519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:44.584380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:44.584688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:44.586706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:44.602918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 628/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 18:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:28:44.608608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:44.695490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:44.705028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce86317-1ce7-4f08-9214-93b83b13fb58 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:44.737397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:44.738025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:44.738307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:44.738582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:44.802447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:44.803923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:44.886946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:44.897356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 654/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 18:28:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 18:28:44.904034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:44.964769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:45.003067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ed7b-8c68-4c1c-9ef2-fabc838a567e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:45.036946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:45.037724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:45.038006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:45.038280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:45.047899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:45.049325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 18:28:45.066168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:45.067219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:45.072547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 18:28:45.072547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 18:28:45.072547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 18:28:45.072547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:45.072547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 629/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:45.073497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:45.168806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916435-2239-4904-8c42-43d7da35a63c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:45.201301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:45.201953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:45.202240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:45.202517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:45.203234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:45.203545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:45.204941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:45.216785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 655/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:45.222312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:45.319009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403f279-012c-4eb4-9d70-159bcbe34f9b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:45.333221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:45.352673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:45.353435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:45.353716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:45.353988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:45.360322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:45.361746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 18:28:45.375543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:45.376595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jun 22 18:28:45.377662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 630/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 18:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:45.382840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:45.431367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:45.481339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d73ae8-a4d8-4825-92ce-b4bd3f9f84af None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:45.518955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:45.519616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:45.521955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:45.521955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:45.521955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:45.521955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:45.523071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579090f4-423f-4422-8a81-73c655483ad9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:45.536087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 656/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 18:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:45.542693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:45.639968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444b04d-f1a8-4ccb-b1db-090daa016821 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:45.674570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:45.675219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:45.675504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:45.675780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:45.676640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] RBAC: Adding query filter params (role.id=5299c6b6eaad463a8c04cf2d50c61c9c, scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab, user.id=9f3f2c10f9fc444aba93f0d999359662) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:45.676957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:45.678391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2923-9819-4621-822c-8f59d6c635f3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:45.684267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 631/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 18:28:45 2022] GET /identity/v3/role_assignments?user.id=9f3f2c10f9fc444aba93f0d999359662&scope.project.id=de94e3ce9f9c4bbe8dc9c99f79c4bcab&role.id=5299c6b6eaad463a8c04cf2d50c61c9c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:47.707142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9c3f-29ee-43e9-afaa-4630e6cce165 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:47.707739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9c3f-29ee-43e9-afaa-4630e6cce165 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:47.707739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9c3f-29ee-43e9-afaa-4630e6cce165 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:47.709118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 657/1288] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:47.714599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:47.715040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:47.715147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:47.731805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:47.733002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:47.761449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:47.798523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 632/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:47.821339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b9c3f-29ee-43e9-afaa-4630e6cce165 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:47.926194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b9c3f-29ee-43e9-afaa-4630e6cce165 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:47.936799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:47.959865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:47.960609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:47.961832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:47.962141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:47.962800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:47.964207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:47.975688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:47.977515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:47.978670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 658/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:28:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:47.984117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:48.078984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c60e-0219-40f0-906e-2a2647081d95 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:48.111646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:48.112331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:48.112620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:48.112900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:48.113608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:48.113921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:48.115285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9ccd-db02-492e-867a-a88fecf31ea7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:48.120456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 633/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 18:28:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:48.126063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:48.231153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3582-abff-4d38-8e7d-423a7a8c527e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:48.263353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:48.264029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:48.264319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:48.264595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:48.265292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:48.265599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:48.266957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f35c-be6f-433f-8a25-ed4a6a2bd1d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:48.271217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 659/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 18:28:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:50.304033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ef44-c3b1-4458-9557-991c21fbaecc None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:50.305163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ef44-c3b1-4458-9557-991c21fbaecc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:50.305163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ef44-c3b1-4458-9557-991c21fbaecc None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:50.306522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 634/1293] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:50.311554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7ee9-5361-4a88-adc6-c491041b84b4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:50.311952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7ee9-5361-4a88-adc6-c491041b84b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:50.312150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7ee9-5361-4a88-adc6-c491041b84b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:50.328663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6d2b7ee9-5361-4a88-adc6-c491041b84b4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:50.329843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6d2b7ee9-5361-4a88-adc6-c491041b84b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:50.358519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:50.395826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 660/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:50.418975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ef44-c3b1-4458-9557-991c21fbaecc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:50.450007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:50.529124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ef44-c3b1-4458-9557-991c21fbaecc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:50.569311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d4d65-9296-489b-8557-4ec5bed19093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:50.569900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d4d65-9296-489b-8557-4ec5bed19093 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:50.570301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d4d65-9296-489b-8557-4ec5bed19093 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:50.570588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d4d65-9296-489b-8557-4ec5bed19093 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:50.571325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d4d65-9296-489b-8557-4ec5bed19093 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:50.572724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d4d65-9296-489b-8557-4ec5bed19093 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:50.585003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 635/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 18:28:50 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:28:52.592720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13d46b-d29a-46a0-aa2c-52160784b7e9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:52.593260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13d46b-d29a-46a0-aa2c-52160784b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:52.593260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13d46b-d29a-46a0-aa2c-52160784b7e9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:52.594651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 661/1296] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:52.599572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4122748-6a00-4177-953b-ba52f887176c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:52.599985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4122748-6a00-4177-953b-ba52f887176c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:52.600163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4122748-6a00-4177-953b-ba52f887176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:52.617586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b4122748-6a00-4177-953b-ba52f887176c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:52.618750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b4122748-6a00-4177-953b-ba52f887176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:52.687585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 636/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:52.709684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13d46b-d29a-46a0-aa2c-52160784b7e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:52.809096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13d46b-d29a-46a0-aa2c-52160784b7e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:52.841447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:52.842229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:52.842513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:52.842840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:52.843434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:52.844829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:52.856833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:52.858034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:52.858928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 662/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:28:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:52.863976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4122748-6a00-4177-953b-ba52f887176c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:52.882388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:52.959493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4122748-6a00-4177-953b-ba52f887176c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:52.992668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:52.993312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:52.993597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:52.993872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:52.994575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:52.994884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:52.996276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:53.001263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 637/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 18:28:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:53.007282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:53.038229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:53.104194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3b6b7-fca1-46fd-adbe-7b57db6bdebf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:53.135807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:53.136537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:53.136824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:53.137102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:53.137890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] RBAC: Adding query filter params (interface=public, service_id=aec25db6d8c64867a557d6a204142b52, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:53.138206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:53.139570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7ef7-0df6-4b23-976e-06f0bff3739f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:53.144457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 663/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 18:28:53 2022] GET /identity/v3/endpoints?service_id=aec25db6d8c64867a557d6a204142b52&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:53.150475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:53.230021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:53.247474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463e087-fc30-4562-8c8c-492b3ba7f3dc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:53.282446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f80b-53b8-4e33-9824-72367c8bd13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:53.283097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f80b-53b8-4e33-9824-72367c8bd13b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:53.283386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f80b-53b8-4e33-9824-72367c8bd13b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:53.283662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f80b-53b8-4e33-9824-72367c8bd13b None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:53.284373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f80b-53b8-4e33-9824-72367c8bd13b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:53.285735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f80b-53b8-4e33-9824-72367c8bd13b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:53.292887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 638/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 18:28:53 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:28:55.292144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b372d-86ee-430e-a970-eb4c049b1787 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:55.292679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b372d-86ee-430e-a970-eb4c049b1787 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:55.292679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b372d-86ee-430e-a970-eb4c049b1787 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:55.294075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 664/1302] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:28:55.299251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:55.299678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:55.299805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:55.317381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:28:55.318583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:28:55.385688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 639/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:28:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 18:28:55.409267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b372d-86ee-430e-a970-eb4c049b1787 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:55.504470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:55.512215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b372d-86ee-430e-a970-eb4c049b1787 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:55.545232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:55.545975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:55.546257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:55.546531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:55.547177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:55.548569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 18:28:55.560655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 18:28:55.561838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 22 18:28:55.562727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 665/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 18:28:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 18:28:55.567680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:55.641097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:28:55.663710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbab96-4124-442a-8ecd-51373058fd8f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:55.696799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:55.697447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:55.697730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:55.698006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:55.698703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:28:55.699009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:55.700409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd670e-77e1-4785-b251-7b474fada0f6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:55.705464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 640/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 18:28:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:28:55.711720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:28:55.807084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b6ad-ccf8-4215-b463-7a933baeff23 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:28:55.839990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a873a-1270-4393-8bec-b6cfe4506191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:28:55.840630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a873a-1270-4393-8bec-b6cfe4506191 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:28:55.840915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a873a-1270-4393-8bec-b6cfe4506191 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:28:55.841191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a873a-1270-4393-8bec-b6cfe4506191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:28:55.841925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a873a-1270-4393-8bec-b6cfe4506191 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:28:55.843280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a873a-1270-4393-8bec-b6cfe4506191 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:28:55.860570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 666/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 18:28:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:29:05.702862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=30 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:29:05.856325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:29:59.137792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d61e0-bad5-4221-9d40-e1a77d1ed145 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:29:59.138254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d61e0-bad5-4221-9d40-e1a77d1ed145 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:29:59.138531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d61e0-bad5-4221-9d40-e1a77d1ed145 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:29:59.145417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ecc7-f9d7-436b-9a5c-d286cec14391 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:29:59.145831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ecc7-f9d7-436b-9a5c-d286cec14391 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:29:59.145989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ecc7-f9d7-436b-9a5c-d286cec14391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:29:59.149421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 641/1307] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:29:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:29:59.221224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-afa3ecc7-f9d7-436b-9a5c-d286cec14391 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:29:59.222432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-afa3ecc7-f9d7-436b-9a5c-d286cec14391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:29:59.344197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 667/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:29:59.382402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce112565-0e57-425e-b4fe-f850293ee609 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:29:59.382775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce112565-0e57-425e-b4fe-f850293ee609 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:29:59.383130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce112565-0e57-425e-b4fe-f850293ee609 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:29:59.384888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 642/1309] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jun 22 18:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:29:59.390919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5376d-8bf6-47c6-806c-6e2dd5cc9640 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:29:59.391217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5376d-8bf6-47c6-806c-6e2dd5cc9640 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:29:59.391506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5376d-8bf6-47c6-806c-6e2dd5cc9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:29:59.500918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cdd5376d-8bf6-47c6-806c-6e2dd5cc9640 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:29:59.502119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cdd5376d-8bf6-47c6-806c-6e2dd5cc9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:29:59.524321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:29:59.584399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 668/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jun 22 18:29:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:29:59.593576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce112565-0e57-425e-b4fe-f850293ee609 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:29:59.595330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ce112565-0e57-425e-b4fe-f850293ee609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:29:59.713327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce112565-0e57-425e-b4fe-f850293ee609 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:29:59.798530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:29:59.799776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:29:59.801469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:29:59.801910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:29:59.803894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:29:59.867461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:29:59.926005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:29:59.927787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537eca0-fbbe-45ca-aaff-98deba374a3e service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:29:59.948785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 643/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:02.353697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9516-e742-42e8-8e9a-45f85b15aa62 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:02.354256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9516-e742-42e8-8e9a-45f85b15aa62 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:02.354256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c9516-e742-42e8-8e9a-45f85b15aa62 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:02.355788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 669/1312] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:02.360769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf871-2797-4caf-a69b-c1a87e5d9cb3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:02.361174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf871-2797-4caf-a69b-c1a87e5d9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:02.361470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf871-2797-4caf-a69b-c1a87e5d9cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:02.442290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-41dbf871-2797-4caf-a69b-c1a87e5d9cb3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:02.443509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-41dbf871-2797-4caf-a69b-c1a87e5d9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:02.543983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 644/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:02.598424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e9c8-f358-435d-af35-7ee63a1dee95 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:02.598821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e9c8-f358-435d-af35-7ee63a1dee95 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:02.599170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e9c8-f358-435d-af35-7ee63a1dee95 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:02.600681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 670/1314] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jun 22 18:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:02.607159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a15dd-1c96-43b1-a130-2610833c1278 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:02.607660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a15dd-1c96-43b1-a130-2610833c1278 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:02.607985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a15dd-1c96-43b1-a130-2610833c1278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:02.618641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:02.693414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9b5a15dd-1c96-43b1-a130-2610833c1278 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:02.694661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9b5a15dd-1c96-43b1-a130-2610833c1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:02.777482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 645/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jun 22 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:02.786418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4e9c8-f358-435d-af35-7ee63a1dee95 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:02.787986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e0c4e9c8-f358-435d-af35-7ee63a1dee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:02.892229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4e9c8-f358-435d-af35-7ee63a1dee95 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:02.964839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:02.967493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:02.968435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:02.968679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:02.969043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:02.971098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:03.077903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:03.079362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22f4e-4426-4556-84cd-64f6f72701a0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:03.098473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 671/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:05.699082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bebe8-c727-41f7-8e91-827cec9c5764 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:05.699607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bebe8-c727-41f7-8e91-827cec9c5764 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:05.699723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bebe8-c727-41f7-8e91-827cec9c5764 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:05.701114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 646/1317] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:05.706934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8d2e-a7b3-4197-b460-07e45a88456b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:05.707356 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8d2e-a7b3-4197-b460-07e45a88456b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:05.707482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8d2e-a7b3-4197-b460-07e45a88456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:05.770713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-497f8d2e-a7b3-4197-b460-07e45a88456b None None] MFA Rules not processed for user `9ac0478d443a4d67a025ec84737cdba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:05.771959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-497f8d2e-a7b3-4197-b460-07e45a88456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:05.823653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:05.867949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 672/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:05.907147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bebe8-c727-41f7-8e91-827cec9c5764 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:05.908736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8e8bebe8-c727-41f7-8e91-827cec9c5764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:06.010803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bebe8-c727-41f7-8e91-827cec9c5764 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:06.013641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:06.084561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:06.085116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:06.085398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:06.085672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:06.087299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:06.191621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:06.193172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced14a16-c54d-4ddb-8ef2-c49838cf1be4 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:06.210586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 647/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:08.881275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354146-3676-47f9-8c78-fab27c54f5ab None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:08.881860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354146-3676-47f9-8c78-fab27c54f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:08.881860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354146-3676-47f9-8c78-fab27c54f5ab None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:08.883242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 673/1320] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:08.888478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb387-2942-45ee-b243-08172d49c953 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:08.888873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb387-2942-45ee-b243-08172d49c953 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:08.889048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb387-2942-45ee-b243-08172d49c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:08.928570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:08.953474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5a0bb387-2942-45ee-b243-08172d49c953 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:08.954689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5a0bb387-2942-45ee-b243-08172d49c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:09.050425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 648/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:09.089817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12354146-3676-47f9-8c78-fab27c54f5ab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:09.091338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-12354146-3676-47f9-8c78-fab27c54f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:09.192110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12354146-3676-47f9-8c78-fab27c54f5ab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:09.262666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:09.263308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:09.263595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:09.263897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:09.265523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:09.272723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:09.373601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:09.374958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1caf2d-47ad-4c30-9e36-7b26986ecb67 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:09.394681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 674/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:12.120285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205ec1-c6ae-42be-a6ae-5f27c2d1bd83 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:12.120795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205ec1-c6ae-42be-a6ae-5f27c2d1bd83 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:12.120795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205ec1-c6ae-42be-a6ae-5f27c2d1bd83 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:12.122451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 649/1323] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:12.128395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2165a-3641-4f4d-9c5e-fc3f89da69ae None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:12.128858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2165a-3641-4f4d-9c5e-fc3f89da69ae None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:12.128858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2165a-3641-4f4d-9c5e-fc3f89da69ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:12.203384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0ab2165a-3641-4f4d-9c5e-fc3f89da69ae None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:12.204987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0ab2165a-3641-4f4d-9c5e-fc3f89da69ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:12.270153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:12.321922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 675/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:12.359081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205ec1-c6ae-42be-a6ae-5f27c2d1bd83 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:12.360734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2b205ec1-c6ae-42be-a6ae-5f27c2d1bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:12.469931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205ec1-c6ae-42be-a6ae-5f27c2d1bd83 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:12.482596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:12.567657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:12.568340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:12.568768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:12.569121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:12.570738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:12.693122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:12.694511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87ec0f-279b-45cb-89b5-9a9f906b2f19 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:12.714173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 650/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:14.824766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52819d8d-9f2a-4b9b-b708-312c7e595a9f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:14.825288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52819d8d-9f2a-4b9b-b708-312c7e595a9f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:14.825399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52819d8d-9f2a-4b9b-b708-312c7e595a9f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:14.826715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 676/1326] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:14.833265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6334-f6e1-41a1-83f1-3f1031f4e360 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:14.833722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6334-f6e1-41a1-83f1-3f1031f4e360 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:14.833835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6334-f6e1-41a1-83f1-3f1031f4e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:14.879522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:14.897823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-247d6334-f6e1-41a1-83f1-3f1031f4e360 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:14.899032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-247d6334-f6e1-41a1-83f1-3f1031f4e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:14.996325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 651/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:15.032939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52819d8d-9f2a-4b9b-b708-312c7e595a9f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:15.034850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52819d8d-9f2a-4b9b-b708-312c7e595a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:15.141616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52819d8d-9f2a-4b9b-b708-312c7e595a9f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:15.218035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:15.218707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:15.218991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:15.219266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:15.220922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:15.239217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:15.333353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:15.334719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e21e71-0648-4b5a-b2e4-4ae805fe8d69 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:15.354822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 677/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:17.477107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61905a-eef2-4ffe-abbb-bbfb5132a0e8 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:17.478051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61905a-eef2-4ffe-abbb-bbfb5132a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:17.478560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61905a-eef2-4ffe-abbb-bbfb5132a0e8 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:17.480236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 652/1329] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:17.485459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b72aeb-069c-4f6e-b170-d3d3c2309203 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:17.486256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b72aeb-069c-4f6e-b170-d3d3c2309203 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:17.486747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b72aeb-069c-4f6e-b170-d3d3c2309203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:17.559304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-73b72aeb-069c-4f6e-b170-d3d3c2309203 None None] MFA Rules not processed for user `9ac0478d443a4d67a025ec84737cdba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:17.560554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-73b72aeb-069c-4f6e-b170-d3d3c2309203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:17.634446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:17.671880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 678/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:17.707363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61905a-eef2-4ffe-abbb-bbfb5132a0e8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:17.708928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7f61905a-eef2-4ffe-abbb-bbfb5132a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:17.818553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61905a-eef2-4ffe-abbb-bbfb5132a0e8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:17.844692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:17.903526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:17.904234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:17.904516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:17.904770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:17.906664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:18.044140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:18.045721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af86b0a-3669-4a9d-befd-5eb7865faa5a service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:18.078372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 653/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:20.398840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914411b-9290-42d8-8a83-b5be619cf9ef None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:20.399440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914411b-9290-42d8-8a83-b5be619cf9ef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:20.399440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914411b-9290-42d8-8a83-b5be619cf9ef None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:20.400811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 679/1332] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:20.405999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1423fb-8000-435f-bdd5-28d53a18bfb8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:20.406452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1423fb-8000-435f-bdd5-28d53a18bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:20.406563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1423fb-8000-435f-bdd5-28d53a18bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:20.466884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:20.469687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6e1423fb-8000-435f-bdd5-28d53a18bfb8 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:20.472502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6e1423fb-8000-435f-bdd5-28d53a18bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:20.568124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 654/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:20.604251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914411b-9290-42d8-8a83-b5be619cf9ef None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:20.605776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7914411b-9290-42d8-8a83-b5be619cf9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:20.710012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914411b-9290-42d8-8a83-b5be619cf9ef None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:20.782466 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:20.783141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:20.784040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:20.784492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:20.786127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:20.812000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:20.893666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:20.895126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19341-782d-4dae-ba01-9a8bac57a5dc service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:20.913547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 680/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:23.010558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434605e-70cb-443d-948c-12affb5cece5 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:23.011072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434605e-70cb-443d-948c-12affb5cece5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:23.011189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434605e-70cb-443d-948c-12affb5cece5 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:23.012604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 655/1335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:23.018683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490370-a297-457a-a56a-4c0b9c079f51 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:23.019115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490370-a297-457a-a56a-4c0b9c079f51 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:23.019285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490370-a297-457a-a56a-4c0b9c079f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:23.084196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f5490370-a297-457a-a56a-4c0b9c079f51 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:23.085319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f5490370-a297-457a-a56a-4c0b9c079f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:23.160641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:23.182978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 681/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:23.225601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434605e-70cb-443d-948c-12affb5cece5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:23.227959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d434605e-70cb-443d-948c-12affb5cece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:23.332710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434605e-70cb-443d-948c-12affb5cece5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:23.360127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:23.404563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:23.405198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:23.405478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:23.405751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:23.407379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:23.512923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:23.514355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f62355-4ae0-4446-97df-9d401c8e90f1 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:23.539584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 656/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:26.256296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856956-5353-4e46-9410-0289cc072dec None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:26.256815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856956-5353-4e46-9410-0289cc072dec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:26.256935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856956-5353-4e46-9410-0289cc072dec None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:26.258246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 682/1338] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:26.263531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9466-081e-484b-ab1b-8c0ed430c060 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:26.263961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9466-081e-484b-ab1b-8c0ed430c060 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:26.264126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9466-081e-484b-ab1b-8c0ed430c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:26.329165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-86dd9466-081e-484b-ab1b-8c0ed430c060 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:26.330475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-86dd9466-081e-484b-ab1b-8c0ed430c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:26.338445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:26.425145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 657/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:26.461858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7856956-5353-4e46-9410-0289cc072dec None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:26.463373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7856956-5353-4e46-9410-0289cc072dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:26.570297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7856956-5353-4e46-9410-0289cc072dec None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:26.641820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:26.642666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:26.642955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:26.643230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:26.644892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:26.680689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:26.752940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:26.754414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acfc06-b6d6-490e-8fde-a3aa81bbe06b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:26.772863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 683/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:30.916874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40916d78-f38d-40ee-a74f-30d31602ffb7 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:30.917379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40916d78-f38d-40ee-a74f-30d31602ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:30.917379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40916d78-f38d-40ee-a74f-30d31602ffb7 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:30.918744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 658/1341] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:30.924110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8d8c-37df-48e4-bc37-ad7f97080094 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:30.924574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8d8c-37df-48e4-bc37-ad7f97080094 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:30.924679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8d8c-37df-48e4-bc37-ad7f97080094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:31.001836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-83ba8d8c-37df-48e4-bc37-ad7f97080094 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:31.003165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-83ba8d8c-37df-48e4-bc37-ad7f97080094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:31.097515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:31.110739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 684/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:30:31.150524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40916d78-f38d-40ee-a74f-30d31602ffb7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:31.152689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-40916d78-f38d-40ee-a74f-30d31602ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:31.253749 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40916d78-f38d-40ee-a74f-30d31602ffb7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:31.257602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0aec-1d55-4b9c-bc6c-5d5d8905dea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:31.258253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0aec-1d55-4b9c-bc6c-5d5d8905dea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:31.258539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0aec-1d55-4b9c-bc6c-5d5d8905dea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:31.258816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0aec-1d55-4b9c-bc6c-5d5d8905dea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:31.269269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0aec-1d55-4b9c-bc6c-5d5d8905dea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:31.270720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0aec-1d55-4b9c-bc6c-5d5d8905dea0 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:31.280806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 659/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:34.015012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130aa5-ac91-4a62-b939-7e9b95cb01d7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:34.015533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130aa5-ac91-4a62-b939-7e9b95cb01d7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:34.015648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130aa5-ac91-4a62-b939-7e9b95cb01d7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:34.017689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 685/1344] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:34.023777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf82378-41ee-455c-8197-a7eb18e960fa None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:34.024369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf82378-41ee-455c-8197-a7eb18e960fa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:34.024483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf82378-41ee-455c-8197-a7eb18e960fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:34.056327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1cf82378-41ee-455c-8197-a7eb18e960fa None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:34.057487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1cf82378-41ee-455c-8197-a7eb18e960fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:34.087784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:34.139786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 660/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:34.179560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130aa5-ac91-4a62-b939-7e9b95cb01d7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:34.192606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130aa5-ac91-4a62-b939-7e9b95cb01d7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:34.196641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95060c85-3b59-4aa5-a87e-acac1e2ee754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:34.197577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95060c85-3b59-4aa5-a87e-acac1e2ee754 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:34.197929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95060c85-3b59-4aa5-a87e-acac1e2ee754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:34.198278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95060c85-3b59-4aa5-a87e-acac1e2ee754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:34.209088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95060c85-3b59-4aa5-a87e-acac1e2ee754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:34.210561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95060c85-3b59-4aa5-a87e-acac1e2ee754 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:34.227865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 686/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:38.458409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650eda9-fef8-45c4-b6f2-89dcdf300c4d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:38.458898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650eda9-fef8-45c4-b6f2-89dcdf300c4d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:38.458898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650eda9-fef8-45c4-b6f2-89dcdf300c4d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:38.467535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 661/1347] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:38.467708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc0bfb-9e9b-48d6-b64a-4aee98e71a1a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:38.467708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc0bfb-9e9b-48d6-b64a-4aee98e71a1a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:38.467708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc0bfb-9e9b-48d6-b64a-4aee98e71a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:38.498304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9bcc0bfb-9e9b-48d6-b64a-4aee98e71a1a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:38.499522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9bcc0bfb-9e9b-48d6-b64a-4aee98e71a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:38.513813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 687/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:30:38.552975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650eda9-fef8-45c4-b6f2-89dcdf300c4d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:38.569919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650eda9-fef8-45c4-b6f2-89dcdf300c4d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:38.574214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba703c-9b00-4b60-8928-35fe629b923b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:38.574972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba703c-9b00-4b60-8928-35fe629b923b service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:38.575440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba703c-9b00-4b60-8928-35fe629b923b service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:38.575787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba703c-9b00-4b60-8928-35fe629b923b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:38.586716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba703c-9b00-4b60-8928-35fe629b923b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:38.588470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba703c-9b00-4b60-8928-35fe629b923b service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:38.599758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 662/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:43.945700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcb9eb-91a9-4998-a88f-24f426883f35 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:43.946643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcb9eb-91a9-4998-a88f-24f426883f35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:43.948913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcb9eb-91a9-4998-a88f-24f426883f35 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:43.951810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 688/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:30:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:43.958422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c849-fd9c-472b-8681-753a597c3ba2 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:43.958873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c849-fd9c-472b-8681-753a597c3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:43.958973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c849-fd9c-472b-8681-753a597c3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:44.087413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1980c849-fd9c-472b-8681-753a597c3ba2 None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:44.090973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1980c849-fd9c-472b-8681-753a597c3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:44.230982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 663/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:48.489965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=13 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:48.517820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fc2b0-3e0b-4e4f-a5ba-a09b13012ce4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:48.518437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fc2b0-3e0b-4e4f-a5ba-a09b13012ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:48.518831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fc2b0-3e0b-4e4f-a5ba-a09b13012ce4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:48.520504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 689/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:48.525799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a89f6-0e95-44c2-8211-43e42f3013d2 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:48.526281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a89f6-0e95-44c2-8211-43e42f3013d2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:48.526697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a89f6-0e95-44c2-8211-43e42f3013d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:48.546447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-003a89f6-0e95-44c2-8211-43e42f3013d2 None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:48.548660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-003a89f6-0e95-44c2-8211-43e42f3013d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:48.557200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 664/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:50.205598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393e8e-58a7-48db-b320-a1c2075fd707 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:50.206185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393e8e-58a7-48db-b320-a1c2075fd707 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:50.206185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393e8e-58a7-48db-b320-a1c2075fd707 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:50.207649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 690/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:50.213261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41eaea-d152-4ae7-9625-a8048dceefa6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:50.213712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41eaea-d152-4ae7-9625-a8048dceefa6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:50.213824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41eaea-d152-4ae7-9625-a8048dceefa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:50.232720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ba41eaea-d152-4ae7-9625-a8048dceefa6 None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:50.233984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ba41eaea-d152-4ae7-9625-a8048dceefa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:50.243355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 665/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:30:53.864885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867873-ad43-469b-8d7c-b49093dc6ad3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:53.865863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867873-ad43-469b-8d7c-b49093dc6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:53.866370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867873-ad43-469b-8d7c-b49093dc6ad3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:53.868274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 691/1356] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:53.874121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c7e90-82d1-4cda-a4ee-776315b0a1bb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:53.874634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c7e90-82d1-4cda-a4ee-776315b0a1bb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:53.874719 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c7e90-82d1-4cda-a4ee-776315b0a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:53.901569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-360c7e90-82d1-4cda-a4ee-776315b0a1bb None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:53.903362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-360c7e90-82d1-4cda-a4ee-776315b0a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:53.916704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 666/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:53.985596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34f90-2bf0-458b-96a9-a8bc5d562a14 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:53.986470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34f90-2bf0-458b-96a9-a8bc5d562a14 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:53.987209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34f90-2bf0-458b-96a9-a8bc5d562a14 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:53.989900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 692/1358] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 18:30:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:54.004402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7763c-c8cb-4f26-87b1-7d8e9d05c88c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:54.005035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7763c-c8cb-4f26-87b1-7d8e9d05c88c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:54.005536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7763c-c8cb-4f26-87b1-7d8e9d05c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:54.054178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:54.062944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-94b7763c-c8cb-4f26-87b1-7d8e9d05c88c None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:54.064299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-94b7763c-c8cb-4f26-87b1-7d8e9d05c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:54.155393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 667/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:54.163448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34f90-2bf0-458b-96a9-a8bc5d562a14 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:54.179666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34f90-2bf0-458b-96a9-a8bc5d562a14 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:54.185615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73298c24-c77a-4d4e-bfed-38a9012741e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:54.186344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298c24-c77a-4d4e-bfed-38a9012741e6 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:54.186706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298c24-c77a-4d4e-bfed-38a9012741e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:54.187060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298c24-c77a-4d4e-bfed-38a9012741e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:54.196556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73298c24-c77a-4d4e-bfed-38a9012741e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:54.198281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73298c24-c77a-4d4e-bfed-38a9012741e6 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:54.208870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 693/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:30:56.495697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe7fa2-7feb-45c9-84b2-e0b438d5b018 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:56.496259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe7fa2-7feb-45c9-84b2-e0b438d5b018 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:56.496368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe7fa2-7feb-45c9-84b2-e0b438d5b018 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:56.497842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 668/1361] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:56.504066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf6d58-972a-4dec-af90-6344ab3c3367 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:56.504514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf6d58-972a-4dec-af90-6344ab3c3367 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:56.504803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf6d58-972a-4dec-af90-6344ab3c3367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:56.522665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c0bf6d58-972a-4dec-af90-6344ab3c3367 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:56.523886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c0bf6d58-972a-4dec-af90-6344ab3c3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:56.531864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 694/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:56.576733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe7fa2-7feb-45c9-84b2-e0b438d5b018 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:56.592385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe7fa2-7feb-45c9-84b2-e0b438d5b018 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:56.598472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac2b74-de96-440f-96ef-4b2f8faa1e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:56.599121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac2b74-de96-440f-96ef-4b2f8faa1e2e service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:56.599404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac2b74-de96-440f-96ef-4b2f8faa1e2e service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:56.599676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac2b74-de96-440f-96ef-4b2f8faa1e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:56.608765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac2b74-de96-440f-96ef-4b2f8faa1e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:56.610904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac2b74-de96-440f-96ef-4b2f8faa1e2e service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:56.620689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 669/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:30:58.984966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831da36-8827-4f2c-9f0f-6fa857b0c9be None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:58.985407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831da36-8827-4f2c-9f0f-6fa857b0c9be None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:58.985521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831da36-8827-4f2c-9f0f-6fa857b0c9be None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:58.986952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 695/1364] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:58.994155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037015f-47e8-43d0-a7ec-3cd5bb33ab67 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:58.994551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037015f-47e8-43d0-a7ec-3cd5bb33ab67 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:58.994718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037015f-47e8-43d0-a7ec-3cd5bb33ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:59.013937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f037015f-47e8-43d0-a7ec-3cd5bb33ab67 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:59.015154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f037015f-47e8-43d0-a7ec-3cd5bb33ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:59.024316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 670/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:59.072574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57bef7-9be7-4394-8463-2c82329203b2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:59.072871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57bef7-9be7-4394-8463-2c82329203b2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:59.073157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57bef7-9be7-4394-8463-2c82329203b2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:59.074528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 696/1366] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 18:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:30:59.082700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7b92-a946-44f5-a503-cdc159ede41c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:59.084345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7b92-a946-44f5-a503-cdc159ede41c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:59.084345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7b92-a946-44f5-a503-cdc159ede41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:59.109008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-93da7b92-a946-44f5-a503-cdc159ede41c None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:30:59.110226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-93da7b92-a946-44f5-a503-cdc159ede41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:30:59.119956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 671/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 18:30:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:30:59.128343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57bef7-9be7-4394-8463-2c82329203b2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:30:59.142938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57bef7-9be7-4394-8463-2c82329203b2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:30:59.148352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d185ba-8fde-42e4-9556-3b5ddf8e1daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:30:59.148991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d185ba-8fde-42e4-9556-3b5ddf8e1daa service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:30:59.149275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d185ba-8fde-42e4-9556-3b5ddf8e1daa service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:30:59.149550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d185ba-8fde-42e4-9556-3b5ddf8e1daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:30:59.157964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d185ba-8fde-42e4-9556-3b5ddf8e1daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:30:59.159549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d185ba-8fde-42e4-9556-3b5ddf8e1daa service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:30:59.168884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 697/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:01.304910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414e10-e5e7-4a5c-8f8f-68d9a7b5c8d0 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:01.306477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414e10-e5e7-4a5c-8f8f-68d9a7b5c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:01.306793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414e10-e5e7-4a5c-8f8f-68d9a7b5c8d0 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:01.309357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 672/1369] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:01.315418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51f04c-c207-49ce-adc5-ea17114d99c3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:01.316380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51f04c-c207-49ce-adc5-ea17114d99c3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:01.316887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51f04c-c207-49ce-adc5-ea17114d99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:01.335861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ba51f04c-c207-49ce-adc5-ea17114d99c3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:01.337351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ba51f04c-c207-49ce-adc5-ea17114d99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:01.356305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 698/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:01.396796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414e10-e5e7-4a5c-8f8f-68d9a7b5c8d0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:01.414242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414e10-e5e7-4a5c-8f8f-68d9a7b5c8d0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:01.420392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320bb6-efb7-49cb-9b82-70f0ad370866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:01.421050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320bb6-efb7-49cb-9b82-70f0ad370866 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:01.421332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320bb6-efb7-49cb-9b82-70f0ad370866 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:01.421602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320bb6-efb7-49cb-9b82-70f0ad370866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:01.431464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320bb6-efb7-49cb-9b82-70f0ad370866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:01.433088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320bb6-efb7-49cb-9b82-70f0ad370866 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:01.444129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 673/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:02.151536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6237-93dc-4db0-86b3-b244e692ca0d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:02.151738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6237-93dc-4db0-86b3-b244e692ca0d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:02.152055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6237-93dc-4db0-86b3-b244e692ca0d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:02.153448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 699/1372] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:02.159476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb7ed5-7f9c-492c-afd0-b2f49f019b39 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:02.159770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb7ed5-7f9c-492c-afd0-b2f49f019b39 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:02.160082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb7ed5-7f9c-492c-afd0-b2f49f019b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:02.179624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e2cb7ed5-7f9c-492c-afd0-b2f49f019b39 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:02.180852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e2cb7ed5-7f9c-492c-afd0-b2f49f019b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:02.189044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 674/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:02.536250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdba5d-9d3e-41ac-a88e-f67e891a38bc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:02.536732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdba5d-9d3e-41ac-a88e-f67e891a38bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:02.536890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdba5d-9d3e-41ac-a88e-f67e891a38bc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:02.539008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 700/1374] 10.222.0.18 () {54 vars in 963 bytes} [Wed Jun 22 18:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:02.543360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00f932-0bf2-41a9-a611-31a06be8e753 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:02.543891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00f932-0bf2-41a9-a611-31a06be8e753 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:02.544083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00f932-0bf2-41a9-a611-31a06be8e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:02.596004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6e00f932-0bf2-41a9-a611-31a06be8e753 None None] MFA Rules not processed for user `01bb9cc9e4c34504ac6574c28963b4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:02.597225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6e00f932-0bf2-41a9-a611-31a06be8e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:02.664120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 675/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Jun 22 18:31:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:02.671503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdba5d-9d3e-41ac-a88e-f67e891a38bc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:02.683341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdba5d-9d3e-41ac-a88e-f67e891a38bc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:02.687050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1b997-ac96-4b01-b993-db7f3bc820ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:02.687808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1b997-ac96-4b01-b993-db7f3bc820ef service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:02.688354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1b997-ac96-4b01-b993-db7f3bc820ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:02.688479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1b997-ac96-4b01-b993-db7f3bc820ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:02.698046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1b997-ac96-4b01-b993-db7f3bc820ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:02.699632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1b997-ac96-4b01-b993-db7f3bc820ef service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:02.709920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 701/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:03.599334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104a33-b0a6-40cd-9605-9eb72fc2e34b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:03.599925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104a33-b0a6-40cd-9605-9eb72fc2e34b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:03.600048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104a33-b0a6-40cd-9605-9eb72fc2e34b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:03.601354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 676/1377] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:03.606530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d27a-afb6-4c7b-8363-8087b9d0bb91 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:03.606952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d27a-afb6-4c7b-8363-8087b9d0bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:03.607210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d27a-afb6-4c7b-8363-8087b9d0bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:03.624679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad13d27a-afb6-4c7b-8363-8087b9d0bb91 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:03.626657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad13d27a-afb6-4c7b-8363-8087b9d0bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:03.634578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 702/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:31:03.678188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104a33-b0a6-40cd-9605-9eb72fc2e34b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:03.693704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104a33-b0a6-40cd-9605-9eb72fc2e34b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:03.699200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a338cf4-9312-4052-a1ab-e24ca40cea4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:03.699861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338cf4-9312-4052-a1ab-e24ca40cea4d service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:03.700148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338cf4-9312-4052-a1ab-e24ca40cea4d service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:03.700426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338cf4-9312-4052-a1ab-e24ca40cea4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:03.709768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a338cf4-9312-4052-a1ab-e24ca40cea4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:03.711392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a338cf4-9312-4052-a1ab-e24ca40cea4d service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:03.715351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:03.722039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 677/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:05.823268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5113-44ba-49fc-a776-80e6b3865c04 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:05.824153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5113-44ba-49fc-a776-80e6b3865c04 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:05.824604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5113-44ba-49fc-a776-80e6b3865c04 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:05.826422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 703/1380] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:05.832457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406720e-f494-4a9f-a904-2d1fed871d34 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:05.832937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406720e-f494-4a9f-a904-2d1fed871d34 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:05.833048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406720e-f494-4a9f-a904-2d1fed871d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:05.851723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8406720e-f494-4a9f-a904-2d1fed871d34 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:05.852939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8406720e-f494-4a9f-a904-2d1fed871d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:05.861224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 678/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:05.905824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a5113-44ba-49fc-a776-80e6b3865c04 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:05.919993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a5113-44ba-49fc-a776-80e6b3865c04 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:05.925587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa7fa-f533-4a6f-b79b-dadb78991ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:05.926213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa7fa-f533-4a6f-b79b-dadb78991ed4 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:05.926497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa7fa-f533-4a6f-b79b-dadb78991ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:05.926773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa7fa-f533-4a6f-b79b-dadb78991ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:05.934723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa7fa-f533-4a6f-b79b-dadb78991ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:05.936328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa7fa-f533-4a6f-b79b-dadb78991ed4 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:05.946281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 704/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:08.034018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf82bc-5de0-4851-b1b7-7f0fd9e7c3ee None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:08.034486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf82bc-5de0-4851-b1b7-7f0fd9e7c3ee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:08.034583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf82bc-5de0-4851-b1b7-7f0fd9e7c3ee None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:08.035932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 679/1383] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:08.041266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d01c6-e0f1-4f5b-8a2f-94aba943be12 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:08.041663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d01c6-e0f1-4f5b-8a2f-94aba943be12 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:08.041836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d01c6-e0f1-4f5b-8a2f-94aba943be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:08.059810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-855d01c6-e0f1-4f5b-8a2f-94aba943be12 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:08.061247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-855d01c6-e0f1-4f5b-8a2f-94aba943be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:08.070211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 705/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:08.111752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf82bc-5de0-4851-b1b7-7f0fd9e7c3ee None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:08.127442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf82bc-5de0-4851-b1b7-7f0fd9e7c3ee None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:08.133400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a4feb-bb33-448f-b47f-762f74033bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:08.134156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4feb-bb33-448f-b47f-762f74033bb3 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:08.134540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4feb-bb33-448f-b47f-762f74033bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:08.134919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4feb-bb33-448f-b47f-762f74033bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:08.144944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a4feb-bb33-448f-b47f-762f74033bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:08.146588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a4feb-bb33-448f-b47f-762f74033bb3 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:08.158461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 680/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:10.243748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2771724-91e1-4d54-8282-7575bcedee38 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:10.243748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2771724-91e1-4d54-8282-7575bcedee38 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:10.243748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2771724-91e1-4d54-8282-7575bcedee38 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:10.252167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 706/1386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:10.252487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96557-553c-4439-b349-d1cae72353df None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:10.261420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96557-553c-4439-b349-d1cae72353df None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:10.261420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96557-553c-4439-b349-d1cae72353df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:10.311480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-18f96557-553c-4439-b349-d1cae72353df None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:10.314587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-18f96557-553c-4439-b349-d1cae72353df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:10.324622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 681/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:10.369210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2771724-91e1-4d54-8282-7575bcedee38 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:10.383907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2771724-91e1-4d54-8282-7575bcedee38 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:10.389697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828aef2-ccb4-42c2-9756-08d9d2008e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:10.390363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aef2-ccb4-42c2-9756-08d9d2008e75 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:10.390676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aef2-ccb4-42c2-9756-08d9d2008e75 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:10.391045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aef2-ccb4-42c2-9756-08d9d2008e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:10.400410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828aef2-ccb4-42c2-9756-08d9d2008e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:10.402019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828aef2-ccb4-42c2-9756-08d9d2008e75 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:10.413066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 707/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:12.479767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a435f-6706-438d-a3d2-a86ec3ee92f8 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:12.480429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a435f-6706-438d-a3d2-a86ec3ee92f8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:12.480429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a435f-6706-438d-a3d2-a86ec3ee92f8 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:12.481730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 682/1389] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:12.486910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad33981-5828-48d0-b91e-66c6a68e3787 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:12.487566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad33981-5828-48d0-b91e-66c6a68e3787 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:12.487794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad33981-5828-48d0-b91e-66c6a68e3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:12.508971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2ad33981-5828-48d0-b91e-66c6a68e3787 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:12.510167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2ad33981-5828-48d0-b91e-66c6a68e3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:12.518921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 708/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:12.563661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a435f-6706-438d-a3d2-a86ec3ee92f8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:12.582148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a435f-6706-438d-a3d2-a86ec3ee92f8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:12.588940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871974e-77ad-46a3-8f2e-a233ad9da8a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:12.589754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871974e-77ad-46a3-8f2e-a233ad9da8a4 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:12.590122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871974e-77ad-46a3-8f2e-a233ad9da8a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:12.590467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871974e-77ad-46a3-8f2e-a233ad9da8a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:12.601654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871974e-77ad-46a3-8f2e-a233ad9da8a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:12.603726 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871974e-77ad-46a3-8f2e-a233ad9da8a4 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:12.616079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 683/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:14.737920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5e1cb-31ad-4d0e-935d-75d1fae50c50 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:14.738475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5e1cb-31ad-4d0e-935d-75d1fae50c50 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:14.738475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5e1cb-31ad-4d0e-935d-75d1fae50c50 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:14.739855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 709/1392] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:14.745614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4701-5aa6-4634-ac05-3208ee10365a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:14.746197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4701-5aa6-4634-ac05-3208ee10365a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:14.746197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4701-5aa6-4634-ac05-3208ee10365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:14.767186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a9ec4701-5aa6-4634-ac05-3208ee10365a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:14.768688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a9ec4701-5aa6-4634-ac05-3208ee10365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:14.778082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 684/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:14.831350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5e1cb-31ad-4d0e-935d-75d1fae50c50 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:14.845985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5e1cb-31ad-4d0e-935d-75d1fae50c50 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:14.851462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d52e-573a-401e-aea3-41fde923290b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:14.852199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d52e-573a-401e-aea3-41fde923290b service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:14.852432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d52e-573a-401e-aea3-41fde923290b service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:14.852710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d52e-573a-401e-aea3-41fde923290b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:14.861543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d52e-573a-401e-aea3-41fde923290b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:14.863129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d52e-573a-401e-aea3-41fde923290b service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:14.872601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 710/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:17.074600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461071-2ecc-41b6-82ae-99aed0245606 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:17.075113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461071-2ecc-41b6-82ae-99aed0245606 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:17.075113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461071-2ecc-41b6-82ae-99aed0245606 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:17.076767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 685/1395] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:17.082587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0c4c-bf7e-42eb-b39a-03615f30d68b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:17.083008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0c4c-bf7e-42eb-b39a-03615f30d68b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:17.083158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0c4c-bf7e-42eb-b39a-03615f30d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:17.102592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a80c0c4c-bf7e-42eb-b39a-03615f30d68b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:17.103805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a80c0c4c-bf7e-42eb-b39a-03615f30d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:17.112753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 711/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:17.158704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461071-2ecc-41b6-82ae-99aed0245606 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:17.173559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461071-2ecc-41b6-82ae-99aed0245606 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:17.178874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6121b1-ad7c-459f-a799-ef4adb65a79d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:17.179502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6121b1-ad7c-459f-a799-ef4adb65a79d service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:17.179788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6121b1-ad7c-459f-a799-ef4adb65a79d service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:17.180094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6121b1-ad7c-459f-a799-ef4adb65a79d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:17.188244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6121b1-ad7c-459f-a799-ef4adb65a79d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:17.189828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6121b1-ad7c-459f-a799-ef4adb65a79d service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:17.199140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 686/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:18.018958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3232c91-96cb-4352-88ce-1fe91b5d322e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:18.019271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3232c91-96cb-4352-88ce-1fe91b5d322e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:18.019549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3232c91-96cb-4352-88ce-1fe91b5d322e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:18.021183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 712/1398] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:18.026349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba566840-e024-4cd5-9cfc-7534725b381a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:18.026585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba566840-e024-4cd5-9cfc-7534725b381a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:18.026871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba566840-e024-4cd5-9cfc-7534725b381a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:18.044962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ba566840-e024-4cd5-9cfc-7534725b381a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:18.046172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ba566840-e024-4cd5-9cfc-7534725b381a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:18.054533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 687/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:18.111303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf668e0-38f3-4162-9f16-10bb3c5fa535 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:18.111730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf668e0-38f3-4162-9f16-10bb3c5fa535 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:18.112020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf668e0-38f3-4162-9f16-10bb3c5fa535 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:18.113428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 713/1400] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jun 22 18:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:18.118475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82bd6-1b7a-4cab-9dbe-6176eadcb2c4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:18.118899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82bd6-1b7a-4cab-9dbe-6176eadcb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:18.119042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82bd6-1b7a-4cab-9dbe-6176eadcb2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:18.168258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e9c82bd6-1b7a-4cab-9dbe-6176eadcb2c4 None None] MFA Rules not processed for user `c8d6c2d367804ad5b3802d487efb13ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:18.169449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e9c82bd6-1b7a-4cab-9dbe-6176eadcb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:18.231295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 688/1401] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jun 22 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:18.239237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf668e0-38f3-4162-9f16-10bb3c5fa535 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:18.249767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf668e0-38f3-4162-9f16-10bb3c5fa535 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:18.253801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32652a9b-d459-4ca4-8780-255274aba99b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:18.254435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652a9b-d459-4ca4-8780-255274aba99b service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:18.254721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652a9b-d459-4ca4-8780-255274aba99b service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:18.254998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652a9b-d459-4ca4-8780-255274aba99b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:18.263783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32652a9b-d459-4ca4-8780-255274aba99b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:18.265244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32652a9b-d459-4ca4-8780-255274aba99b service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:18.278976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 714/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:18.993645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae662c-9ed4-4e15-a518-bdbba0c187b3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:18.993942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae662c-9ed4-4e15-a518-bdbba0c187b3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:18.994220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae662c-9ed4-4e15-a518-bdbba0c187b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.044639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4fae662c-9ed4-4e15-a518-bdbba0c187b3 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:19.045845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4fae662c-9ed4-4e15-a518-bdbba0c187b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:19.087606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:19.113309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 689/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:19.158875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798f2d3-840b-472c-aa80-18b7c5b56332 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:19.159338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798f2d3-840b-472c-aa80-18b7c5b56332 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:19.159583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798f2d3-840b-472c-aa80-18b7c5b56332 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.161119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 715/1404] 10.222.0.18 () {54 vars in 942 bytes} [Wed Jun 22 18:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:19.167566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:19.167999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:19.168284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.217781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] MFA Rules not processed for user `a82d117152a54ebcbd6cf9291bef3f97`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:19.218944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:19.260609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14b24-9be3-4085-82dc-def0f0edd25d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:19.260900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14b24-9be3-4085-82dc-def0f0edd25d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:19.261183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14b24-9be3-4085-82dc-def0f0edd25d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.262563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 716/1405] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:31:19.268298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:19.268591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:19.268876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.274884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=61 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:19.288155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:19.289348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:19.292428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 690/1406] 10.222.0.18 () {58 vars in 1039 bytes} [Wed Jun 22 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:19.297153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 717/1407] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:31:19.302082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:19.311744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b33d92-285a-4705-b8c4-3474e5ef0e82 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:19.318102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362f45-9060-4183-b3e8-9fba5c1d622e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:19.318750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362f45-9060-4183-b3e8-9fba5c1d622e service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:19.319031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362f45-9060-4183-b3e8-9fba5c1d622e service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:19.319442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362f45-9060-4183-b3e8-9fba5c1d622e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.328023 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97362f45-9060-4183-b3e8-9fba5c1d622e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:19.330624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97362f45-9060-4183-b3e8-9fba5c1d622e service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:19.339061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 691/1408] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 18:31:19.341557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:19.355588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbd70-36ac-4c81-84f3-b9e81bb3b3ae None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:19.363196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4849119-ad08-47bb-8323-2183bb943982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:19.363878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4849119-ad08-47bb-8323-2183bb943982 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:19.364172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4849119-ad08-47bb-8323-2183bb943982 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:19.364452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4849119-ad08-47bb-8323-2183bb943982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:19.376134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4849119-ad08-47bb-8323-2183bb943982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:19.378026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4849119-ad08-47bb-8323-2183bb943982 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:19.388137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 718/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:31:29.335396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=59 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:29.383618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=8 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:41.746446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a47601-f7b1-43e2-8eaa-30995f5c9e9c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:41.746978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a47601-f7b1-43e2-8eaa-30995f5c9e9c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:41.746978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a47601-f7b1-43e2-8eaa-30995f5c9e9c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:41.748383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 692/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jun 22 18:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:41.754995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb544-2050-400b-ac62-eee713528dfd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:41.755435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb544-2050-400b-ac62-eee713528dfd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:41.755548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb544-2050-400b-ac62-eee713528dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:41.773669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2c9eb544-2050-400b-ac62-eee713528dfd None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:41.774879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2c9eb544-2050-400b-ac62-eee713528dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:41.783470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 719/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jun 22 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:41.797488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf17c-6baf-4cbf-8078-cf0ff44e897a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:41.797776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf17c-6baf-4cbf-8078-cf0ff44e897a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:41.798054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf17c-6baf-4cbf-8078-cf0ff44e897a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:41.799412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 693/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jun 22 18:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:41.803895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bd377-7a06-433c-afc7-cc5a44fdd6cb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:41.804190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bd377-7a06-433c-afc7-cc5a44fdd6cb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:41.804470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bd377-7a06-433c-afc7-cc5a44fdd6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:41.822347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c06bd377-7a06-433c-afc7-cc5a44fdd6cb None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:41.823517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c06bd377-7a06-433c-afc7-cc5a44fdd6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:41.833406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 720/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jun 22 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:44.325790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc844d-d024-4fd1-866b-f765bc2a7691 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:44.326361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc844d-d024-4fd1-866b-f765bc2a7691 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:44.326361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc844d-d024-4fd1-866b-f765bc2a7691 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:44.327718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:44.333525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb109d1e-8519-41af-b081-3b7ceeb2c1ca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:44.333970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb109d1e-8519-41af-b081-3b7ceeb2c1ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:44.334074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb109d1e-8519-41af-b081-3b7ceeb2c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:44.353102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cb109d1e-8519-41af-b081-3b7ceeb2c1ca None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:44.354317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cb109d1e-8519-41af-b081-3b7ceeb2c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:44.362165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:44.405746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc844d-d024-4fd1-866b-f765bc2a7691 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:44.421304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc844d-d024-4fd1-866b-f765bc2a7691 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:44.428257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78b112-2f5a-4eb6-ae37-dbd5d2d44ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:44.428893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78b112-2f5a-4eb6-ae37-dbd5d2d44ceb service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:44.429178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78b112-2f5a-4eb6-ae37-dbd5d2d44ceb service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:44.429456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78b112-2f5a-4eb6-ae37-dbd5d2d44ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:44.437569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78b112-2f5a-4eb6-ae37-dbd5d2d44ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:44.439173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78b112-2f5a-4eb6-ae37-dbd5d2d44ceb service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:44.449005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 695/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:45.347905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236ca54-d0ee-4f01-99a3-f610480bae8c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:45.348446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236ca54-d0ee-4f01-99a3-f610480bae8c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:45.348544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236ca54-d0ee-4f01-99a3-f610480bae8c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:45.349977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:45.354994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a9ab-6ebf-4805-af5d-d3dd78e6b32b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:45.355409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a9ab-6ebf-4805-af5d-d3dd78e6b32b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:45.355556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a9ab-6ebf-4805-af5d-d3dd78e6b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:45.373372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d874a9ab-6ebf-4805-af5d-d3dd78e6b32b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:45.374563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d874a9ab-6ebf-4805-af5d-d3dd78e6b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:45.383371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:45.534110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236ca54-d0ee-4f01-99a3-f610480bae8c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:45.549255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236ca54-d0ee-4f01-99a3-f610480bae8c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:45.556527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64566e1a-8f68-44ce-a077-064f6d91c0d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:45.557163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566e1a-8f68-44ce-a077-064f6d91c0d5 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:45.557455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566e1a-8f68-44ce-a077-064f6d91c0d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:45.557734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566e1a-8f68-44ce-a077-064f6d91c0d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:45.566043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64566e1a-8f68-44ce-a077-064f6d91c0d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:45.567682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64566e1a-8f68-44ce-a077-064f6d91c0d5 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:45.577096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 723/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:46.454613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ebbc6-fff3-4c40-9c80-af2e34f6a211 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:46.455215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ebbc6-fff3-4c40-9c80-af2e34f6a211 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:46.455215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ebbc6-fff3-4c40-9c80-af2e34f6a211 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:46.456652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:46.461480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66ebd8-cf4a-4356-bf7c-1141bae7e893 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:46.461887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66ebd8-cf4a-4356-bf7c-1141bae7e893 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:46.462043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66ebd8-cf4a-4356-bf7c-1141bae7e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:46.480140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fe66ebd8-cf4a-4356-bf7c-1141bae7e893 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:46.481330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe66ebd8-cf4a-4356-bf7c-1141bae7e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:46.489715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:46.640249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ebbc6-fff3-4c40-9c80-af2e34f6a211 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:46.654965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ebbc6-fff3-4c40-9c80-af2e34f6a211 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:46.661129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397c86f-96cd-420d-8896-fd52e2b174bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:46.661756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c86f-96cd-420d-8896-fd52e2b174bf service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:46.662042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c86f-96cd-420d-8896-fd52e2b174bf service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:46.662317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c86f-96cd-420d-8896-fd52e2b174bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:46.670347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397c86f-96cd-420d-8896-fd52e2b174bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:46.671969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397c86f-96cd-420d-8896-fd52e2b174bf service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:46.681228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 698/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:47.566510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d872-bc9f-4f9a-9745-29340cb48988 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:47.567056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d872-bc9f-4f9a-9745-29340cb48988 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:47.567056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d872-bc9f-4f9a-9745-29340cb48988 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:47.568532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:47.573571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae529-65aa-4be4-80a1-18178d57ca53 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:47.574004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae529-65aa-4be4-80a1-18178d57ca53 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:47.574144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae529-65aa-4be4-80a1-18178d57ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:47.593293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-21dae529-65aa-4be4-80a1-18178d57ca53 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:47.594488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-21dae529-65aa-4be4-80a1-18178d57ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:47.603002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:47.751372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737d872-bc9f-4f9a-9745-29340cb48988 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:47.766240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737d872-bc9f-4f9a-9745-29340cb48988 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:47.772180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66745b-4653-41a5-8a34-e1f2e3d4d2b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:47.772827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66745b-4653-41a5-8a34-e1f2e3d4d2b6 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:47.773114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66745b-4653-41a5-8a34-e1f2e3d4d2b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:47.773392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66745b-4653-41a5-8a34-e1f2e3d4d2b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:47.782613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66745b-4653-41a5-8a34-e1f2e3d4d2b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:47.784589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66745b-4653-41a5-8a34-e1f2e3d4d2b6 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:47.794900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 726/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:48.650619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234ece-5a3c-4e9d-817e-9dd802d10e2f None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:48.651172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234ece-5a3c-4e9d-817e-9dd802d10e2f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:48.651172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234ece-5a3c-4e9d-817e-9dd802d10e2f None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:48.652579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:48.657458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623984-c736-4847-9b6a-3fb0d08a7e43 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:48.658713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623984-c736-4847-9b6a-3fb0d08a7e43 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:48.658713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623984-c736-4847-9b6a-3fb0d08a7e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:48.676665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-70623984-c736-4847-9b6a-3fb0d08a7e43 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:48.677856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70623984-c736-4847-9b6a-3fb0d08a7e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:48.685542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:48.833506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234ece-5a3c-4e9d-817e-9dd802d10e2f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:48.848772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234ece-5a3c-4e9d-817e-9dd802d10e2f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:48.854055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b69c42-9404-4fe7-9cc7-bc6962e974cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:48.854688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b69c42-9404-4fe7-9cc7-bc6962e974cc service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:48.854969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b69c42-9404-4fe7-9cc7-bc6962e974cc service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:48.855243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b69c42-9404-4fe7-9cc7-bc6962e974cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:48.863439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b69c42-9404-4fe7-9cc7-bc6962e974cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:48.865068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b69c42-9404-4fe7-9cc7-bc6962e974cc service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:48.874546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 701/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:49.678938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441cfc-3fd8-4998-a185-879855860221 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:49.679516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441cfc-3fd8-4998-a185-879855860221 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:49.679516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441cfc-3fd8-4998-a185-879855860221 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:49.680945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:49.685772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336df4-bf4a-4e72-b320-327957cd9182 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:49.686206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336df4-bf4a-4e72-b320-327957cd9182 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:49.686329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336df4-bf4a-4e72-b320-327957cd9182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:49.705457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f8336df4-bf4a-4e72-b320-327957cd9182 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:49.706659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f8336df4-bf4a-4e72-b320-327957cd9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:49.714426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:49.864728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441cfc-3fd8-4998-a185-879855860221 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:49.879794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441cfc-3fd8-4998-a185-879855860221 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:49.885232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc5f3-7264-4e38-aae5-80c1b540163c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:49.885873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc5f3-7264-4e38-aae5-80c1b540163c service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:49.886159 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc5f3-7264-4e38-aae5-80c1b540163c service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:49.886436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc5f3-7264-4e38-aae5-80c1b540163c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:49.895057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dc5f3-7264-4e38-aae5-80c1b540163c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:49.896696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dc5f3-7264-4e38-aae5-80c1b540163c service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:49.906246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 729/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:50.734931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3e96-f8e5-49c2-a084-f959c58b6d4e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:50.735474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3e96-f8e5-49c2-a084-f959c58b6d4e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:50.735474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3e96-f8e5-49c2-a084-f959c58b6d4e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:50.738960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:50.744866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16401-5e57-4420-945d-ef9b9554b778 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:50.745367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16401-5e57-4420-945d-ef9b9554b778 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:50.745474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16401-5e57-4420-945d-ef9b9554b778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:50.763303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-28e16401-5e57-4420-945d-ef9b9554b778 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:50.764518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-28e16401-5e57-4420-945d-ef9b9554b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:50.772428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:50.922754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de3e96-f8e5-49c2-a084-f959c58b6d4e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:50.937689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de3e96-f8e5-49c2-a084-f959c58b6d4e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:50.943620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aba2b-749f-4ca7-955e-d6fbb86f91cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:50.944291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aba2b-749f-4ca7-955e-d6fbb86f91cf service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:50.944578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aba2b-749f-4ca7-955e-d6fbb86f91cf service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:50.944856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aba2b-749f-4ca7-955e-d6fbb86f91cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:50.953044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aba2b-749f-4ca7-955e-d6fbb86f91cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:50.954633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aba2b-749f-4ca7-955e-d6fbb86f91cf service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:50.964491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 704/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:51.799802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911727-b615-4ef7-a3a2-a74f3fde14d7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:51.800294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911727-b615-4ef7-a3a2-a74f3fde14d7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:51.800533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911727-b615-4ef7-a3a2-a74f3fde14d7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:51.801916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:51.806872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45b1d-0a71-4733-82fd-0dabe34d786a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:51.807300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45b1d-0a71-4733-82fd-0dabe34d786a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:51.807419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45b1d-0a71-4733-82fd-0dabe34d786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:51.824878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d1b45b1d-0a71-4733-82fd-0dabe34d786a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:51.826057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d1b45b1d-0a71-4733-82fd-0dabe34d786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:51.834294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:51.985622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911727-b615-4ef7-a3a2-a74f3fde14d7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:51.999676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911727-b615-4ef7-a3a2-a74f3fde14d7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:52.005822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc4246-f9f4-408a-b28c-bea6b1a3dc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:52.006447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4246-f9f4-408a-b28c-bea6b1a3dc3f service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:52.006729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4246-f9f4-408a-b28c-bea6b1a3dc3f service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:52.007001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4246-f9f4-408a-b28c-bea6b1a3dc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:52.014928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc4246-f9f4-408a-b28c-bea6b1a3dc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:52.016539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc4246-f9f4-408a-b28c-bea6b1a3dc3f service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:52.026753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 732/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:52.825777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672863b-41af-4160-92b0-6f20c7b02aba None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:52.826406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672863b-41af-4160-92b0-6f20c7b02aba None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:52.826406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672863b-41af-4160-92b0-6f20c7b02aba None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:52.827723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:52.832775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456558-b9bf-4f41-85a3-99c4dadb62fe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:52.833191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456558-b9bf-4f41-85a3-99c4dadb62fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:52.833341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456558-b9bf-4f41-85a3-99c4dadb62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:52.850876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-05456558-b9bf-4f41-85a3-99c4dadb62fe None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:52.852107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05456558-b9bf-4f41-85a3-99c4dadb62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:52.859785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:53.008355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672863b-41af-4160-92b0-6f20c7b02aba None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:53.023152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672863b-41af-4160-92b0-6f20c7b02aba None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:53.028556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b983a-ce7e-4512-a45b-1396723d47af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:53.029195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b983a-ce7e-4512-a45b-1396723d47af service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:53.029480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b983a-ce7e-4512-a45b-1396723d47af service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:53.029758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b983a-ce7e-4512-a45b-1396723d47af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:53.040103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b983a-ce7e-4512-a45b-1396723d47af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:53.042484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b983a-ce7e-4512-a45b-1396723d47af service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:53.052307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 707/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:54.971041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062395c-07f5-4c9d-b746-0b9353e7b4b6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:54.971603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062395c-07f5-4c9d-b746-0b9353e7b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:54.971716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062395c-07f5-4c9d-b746-0b9353e7b4b6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:54.973070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:54.978492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b955147-6622-41f9-99f0-926d10881581 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:54.978926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b955147-6622-41f9-99f0-926d10881581 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:54.979187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b955147-6622-41f9-99f0-926d10881581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:54.997264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5b955147-6622-41f9-99f0-926d10881581 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:54.998462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5b955147-6622-41f9-99f0-926d10881581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:55.007442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:31:55.045139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062395c-07f5-4c9d-b746-0b9353e7b4b6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:55.056367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062395c-07f5-4c9d-b746-0b9353e7b4b6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:55.059795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694deca-0fd7-44e4-b4f7-79551c422c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:55.060453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694deca-0fd7-44e4-b4f7-79551c422c57 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:55.060735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694deca-0fd7-44e4-b4f7-79551c422c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:55.061007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694deca-0fd7-44e4-b4f7-79551c422c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:55.071383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694deca-0fd7-44e4-b4f7-79551c422c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:55.072872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694deca-0fd7-44e4-b4f7-79551c422c57 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:55.082843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 735/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:57.421965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f1f6-7663-41f0-aa19-5e1079ecee31 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:57.422536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f1f6-7663-41f0-aa19-5e1079ecee31 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:57.422536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f1f6-7663-41f0-aa19-5e1079ecee31 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:57.424421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:57.429613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883775-932c-4893-9978-8fdbe9aee49f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:57.430068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883775-932c-4893-9978-8fdbe9aee49f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:57.430176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883775-932c-4893-9978-8fdbe9aee49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:57.448008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-57883775-932c-4893-9978-8fdbe9aee49f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:57.449194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-57883775-932c-4893-9978-8fdbe9aee49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:57.457465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:57.494598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83f1f6-7663-41f0-aa19-5e1079ecee31 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:57.506347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83f1f6-7663-41f0-aa19-5e1079ecee31 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:57.509882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbda2d1-e208-47d7-bf26-d783ccb50d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:57.510506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbda2d1-e208-47d7-bf26-d783ccb50d15 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:57.510789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbda2d1-e208-47d7-bf26-d783ccb50d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:57.511063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbda2d1-e208-47d7-bf26-d783ccb50d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:57.520621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbda2d1-e208-47d7-bf26-d783ccb50d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:31:57.522048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbda2d1-e208-47d7-bf26-d783ccb50d15 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:31:57.531199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 710/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:59.904092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a6f4-6090-4019-a2fc-675e94ea880b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:59.904652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a6f4-6090-4019-a2fc-675e94ea880b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:59.904652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a6f4-6090-4019-a2fc-675e94ea880b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:59.906037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:31:59.911233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b495-fdbb-4cdd-8203-6a37599c6a01 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:59.911648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b495-fdbb-4cdd-8203-6a37599c6a01 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:59.911817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b495-fdbb-4cdd-8203-6a37599c6a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:31:59.929061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1588b495-fdbb-4cdd-8203-6a37599c6a01 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:31:59.930248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1588b495-fdbb-4cdd-8203-6a37599c6a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:31:59.937941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:31:59.979513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a6f4-6090-4019-a2fc-675e94ea880b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:31:59.991312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a6f4-6090-4019-a2fc-675e94ea880b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:31:59.995057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da19d8-ceda-46e2-aed0-0f0b18c1a41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:31:59.995732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da19d8-ceda-46e2-aed0-0f0b18c1a41b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:31:59.996069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da19d8-ceda-46e2-aed0-0f0b18c1a41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:31:59.996371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da19d8-ceda-46e2-aed0-0f0b18c1a41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:00.006431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da19d8-ceda-46e2-aed0-0f0b18c1a41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:00.007891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da19d8-ceda-46e2-aed0-0f0b18c1a41b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:00.017146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 738/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:02.169483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde9fc-2c2c-49c2-a99e-17a0f02571bf None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:02.170011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde9fc-2c2c-49c2-a99e-17a0f02571bf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:02.170011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde9fc-2c2c-49c2-a99e-17a0f02571bf None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:02.171346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:02.177345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65136-31fb-45b2-824c-7df56e967233 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:02.177790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65136-31fb-45b2-824c-7df56e967233 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:02.177925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65136-31fb-45b2-824c-7df56e967233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:02.195169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-36d65136-31fb-45b2-824c-7df56e967233 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:02.196372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-36d65136-31fb-45b2-824c-7df56e967233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:02.204026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:02.243557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde9fc-2c2c-49c2-a99e-17a0f02571bf None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:02.245231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-04cde9fc-2c2c-49c2-a99e-17a0f02571bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:02.258216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde9fc-2c2c-49c2-a99e-17a0f02571bf None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:02.261725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0f683-3ec4-4927-8440-f5502c050224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:02.262348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0f683-3ec4-4927-8440-f5502c050224 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:02.262630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0f683-3ec4-4927-8440-f5502c050224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:02.262907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0f683-3ec4-4927-8440-f5502c050224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:02.272110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0f683-3ec4-4927-8440-f5502c050224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:02.273521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0f683-3ec4-4927-8440-f5502c050224 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:02.282703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 713/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:04.500863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d67f-b0a6-451d-b363-9e7741ac58b9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:04.501407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d67f-b0a6-451d-b363-9e7741ac58b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:04.501407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d67f-b0a6-451d-b363-9e7741ac58b9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:04.502835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:04.508335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b19163-0d66-4089-acfb-cdc0f7378894 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:04.508784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b19163-0d66-4089-acfb-cdc0f7378894 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:04.508910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b19163-0d66-4089-acfb-cdc0f7378894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:04.527569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-42b19163-0d66-4089-acfb-cdc0f7378894 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:04.528849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-42b19163-0d66-4089-acfb-cdc0f7378894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:04.538077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:04.576173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d67f-b0a6-451d-b363-9e7741ac58b9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:04.587902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d67f-b0a6-451d-b363-9e7741ac58b9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:04.591378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eee72-4cf5-4fa0-a72e-5ff7fbf38bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:04.592050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eee72-4cf5-4fa0-a72e-5ff7fbf38bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:04.592339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eee72-4cf5-4fa0-a72e-5ff7fbf38bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:04.592619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eee72-4cf5-4fa0-a72e-5ff7fbf38bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:04.602548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eee72-4cf5-4fa0-a72e-5ff7fbf38bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:04.604033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eee72-4cf5-4fa0-a72e-5ff7fbf38bd6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:04.613771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 741/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:06.770575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1a0dd-fc39-4468-b301-9abde8fd910e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:06.771157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1a0dd-fc39-4468-b301-9abde8fd910e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:06.771157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1a0dd-fc39-4468-b301-9abde8fd910e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:06.772977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:06.777855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9940-77bd-45b0-b81b-25249eebd51e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:06.778234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9940-77bd-45b0-b81b-25249eebd51e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:06.778425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9940-77bd-45b0-b81b-25249eebd51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:06.796343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-52cb9940-77bd-45b0-b81b-25249eebd51e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:06.797545 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52cb9940-77bd-45b0-b81b-25249eebd51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:06.805550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:06.843258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1a0dd-fc39-4468-b301-9abde8fd910e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:06.854498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1a0dd-fc39-4468-b301-9abde8fd910e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:06.857989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551f566-3c1f-44a3-b5ea-f6a8e3be5a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:06.858618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551f566-3c1f-44a3-b5ea-f6a8e3be5a29 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:06.858902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551f566-3c1f-44a3-b5ea-f6a8e3be5a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:06.859180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551f566-3c1f-44a3-b5ea-f6a8e3be5a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:06.868006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551f566-3c1f-44a3-b5ea-f6a8e3be5a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:06.869434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551f566-3c1f-44a3-b5ea-f6a8e3be5a29 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:06.878771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 716/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:08.971788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53bf79-54bb-4da5-adf1-e7a70c57c0bc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:08.972386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53bf79-54bb-4da5-adf1-e7a70c57c0bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:08.972386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53bf79-54bb-4da5-adf1-e7a70c57c0bc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:08.973817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:08.979106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781546-a87e-4816-b86d-b1c47a36d241 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:08.979538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781546-a87e-4816-b86d-b1c47a36d241 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:08.979661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781546-a87e-4816-b86d-b1c47a36d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:08.997527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f8781546-a87e-4816-b86d-b1c47a36d241 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:08.998731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f8781546-a87e-4816-b86d-b1c47a36d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:09.007382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:09.043975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53bf79-54bb-4da5-adf1-e7a70c57c0bc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:09.055195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53bf79-54bb-4da5-adf1-e7a70c57c0bc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:09.058661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad87863-3a4a-484d-bfd9-ee443f18a585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:09.059334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87863-3a4a-484d-bfd9-ee443f18a585 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:09.059617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87863-3a4a-484d-bfd9-ee443f18a585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:09.059922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87863-3a4a-484d-bfd9-ee443f18a585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:09.069630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad87863-3a4a-484d-bfd9-ee443f18a585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:09.071059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad87863-3a4a-484d-bfd9-ee443f18a585 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:09.080435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 744/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:11.145534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf87f49-7196-4d29-a58c-17e4a183f17e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:11.146090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf87f49-7196-4d29-a58c-17e4a183f17e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:11.146090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf87f49-7196-4d29-a58c-17e4a183f17e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:11.147470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:11.152864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34d02-7b89-4097-8ba1-5d8fbb084ebd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:11.153297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34d02-7b89-4097-8ba1-5d8fbb084ebd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:11.153421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34d02-7b89-4097-8ba1-5d8fbb084ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:11.159376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=79 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:11.172302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9ff34d02-7b89-4097-8ba1-5d8fbb084ebd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:11.173481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9ff34d02-7b89-4097-8ba1-5d8fbb084ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:11.181212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:11.221303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf87f49-7196-4d29-a58c-17e4a183f17e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:11.228320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=73 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:11.234958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf87f49-7196-4d29-a58c-17e4a183f17e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:11.239350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07a33-30ef-4672-a459-04c7706d0dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:11.240015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07a33-30ef-4672-a459-04c7706d0dab service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:11.240302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07a33-30ef-4672-a459-04c7706d0dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:11.240601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07a33-30ef-4672-a459-04c7706d0dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:11.249462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d07a33-30ef-4672-a459-04c7706d0dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:11.250953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d07a33-30ef-4672-a459-04c7706d0dab service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:11.261887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 719/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:13.339547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152299db-b6ab-4052-a51a-171279642ced None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:13.340142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152299db-b6ab-4052-a51a-171279642ced None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:13.340142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152299db-b6ab-4052-a51a-171279642ced None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:13.341406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:13.347382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d7f02-ad54-42f0-b5d4-daad717a80c1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:13.348059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d7f02-ad54-42f0-b5d4-daad717a80c1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:13.348185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d7f02-ad54-42f0-b5d4-daad717a80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:13.366061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-368d7f02-ad54-42f0-b5d4-daad717a80c1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:13.367244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-368d7f02-ad54-42f0-b5d4-daad717a80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:13.375351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:32:13.412242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152299db-b6ab-4052-a51a-171279642ced None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:13.423059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152299db-b6ab-4052-a51a-171279642ced None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:13.426838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e144f37-f770-490c-af59-1d5d91d3d95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:13.427702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e144f37-f770-490c-af59-1d5d91d3d95a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:13.428018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e144f37-f770-490c-af59-1d5d91d3d95a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:13.428295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e144f37-f770-490c-af59-1d5d91d3d95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:13.437798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e144f37-f770-490c-af59-1d5d91d3d95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:13.439776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e144f37-f770-490c-af59-1d5d91d3d95a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:13.449781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 747/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:32:15.525359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa91c-643f-454d-85cf-3dac607887dd None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:15.525903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa91c-643f-454d-85cf-3dac607887dd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:15.525903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa91c-643f-454d-85cf-3dac607887dd None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:15.527293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:15.532858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562ca2b-1a1c-4240-a2f6-4abf3a98abc6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:15.533798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562ca2b-1a1c-4240-a2f6-4abf3a98abc6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:15.534126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562ca2b-1a1c-4240-a2f6-4abf3a98abc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:15.553654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1562ca2b-1a1c-4240-a2f6-4abf3a98abc6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:15.554846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1562ca2b-1a1c-4240-a2f6-4abf3a98abc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:15.562975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:15.601798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa91c-643f-454d-85cf-3dac607887dd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:15.613926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa91c-643f-454d-85cf-3dac607887dd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:15.617571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1662ce-d3a4-4070-8a93-041ebe5d6ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:15.618220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1662ce-d3a4-4070-8a93-041ebe5d6ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:15.618506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1662ce-d3a4-4070-8a93-041ebe5d6ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:15.618777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1662ce-d3a4-4070-8a93-041ebe5d6ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:15.629138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1662ce-d3a4-4070-8a93-041ebe5d6ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:15.630852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1662ce-d3a4-4070-8a93-041ebe5d6ed4 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:15.640979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 722/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:25.547130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=11 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:25.636434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=14 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:35.595177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b54c9-fc64-4768-b022-da515e5a6fde None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:35.596580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b54c9-fc64-4768-b022-da515e5a6fde None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:35.596894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b54c9-fc64-4768-b022-da515e5a6fde None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:35.598927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 749/1471] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:35.605662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6500-a5df-466b-9e86-78bfd43eb2dd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:35.606187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6500-a5df-466b-9e86-78bfd43eb2dd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:35.606300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6500-a5df-466b-9e86-78bfd43eb2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:35.625584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8f7e6500-a5df-466b-9e86-78bfd43eb2dd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:35.627477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8f7e6500-a5df-466b-9e86-78bfd43eb2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:35.636155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 723/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:32:35.690864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590299d7-2985-4c68-b926-921bcfdda57b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:35.691153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590299d7-2985-4c68-b926-921bcfdda57b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:35.691432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590299d7-2985-4c68-b926-921bcfdda57b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:35.692881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 750/1473] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jun 22 18:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:35.699355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a3fa-aa96-4564-8f11-85d289e8d076 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:35.699649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a3fa-aa96-4564-8f11-85d289e8d076 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:35.699963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a3fa-aa96-4564-8f11-85d289e8d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:35.719483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8793a3fa-aa96-4564-8f11-85d289e8d076 None None] MFA Rules not processed for user `c8d6c2d367804ad5b3802d487efb13ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:35.721298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8793a3fa-aa96-4564-8f11-85d289e8d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:35.729069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 724/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jun 22 18:32:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:35.742359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590299d7-2985-4c68-b926-921bcfdda57b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:35.756105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590299d7-2985-4c68-b926-921bcfdda57b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:35.760522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6fa50-514f-43f9-b5ee-0226abb2751b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:35.761425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6fa50-514f-43f9-b5ee-0226abb2751b service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:35.761714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6fa50-514f-43f9-b5ee-0226abb2751b service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:35.762172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6fa50-514f-43f9-b5ee-0226abb2751b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:35.775089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6fa50-514f-43f9-b5ee-0226abb2751b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:35.776579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6fa50-514f-43f9-b5ee-0226abb2751b service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:35.788554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 751/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:37.953030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9b37a-d799-49df-a3cc-567f7689f22e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:37.953600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9b37a-d799-49df-a3cc-567f7689f22e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:37.953600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9b37a-d799-49df-a3cc-567f7689f22e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:37.955041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 725/1476] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:37.960510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fc5ea-8956-4709-88e2-3883b8d8deb4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:37.960948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fc5ea-8956-4709-88e2-3883b8d8deb4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:37.961108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fc5ea-8956-4709-88e2-3883b8d8deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:37.980694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-df3fc5ea-8956-4709-88e2-3883b8d8deb4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:37.981895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df3fc5ea-8956-4709-88e2-3883b8d8deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:37.990463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 752/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:32:38.014108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9b37a-d799-49df-a3cc-567f7689f22e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:38.026442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9b37a-d799-49df-a3cc-567f7689f22e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:38.030717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:38.031347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:38.031627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:38.031928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:38.032655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:38.034930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:32:38.034930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:32:38.034930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:32:38.036110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43254070-afa3-4c7f-b395-8806ec97050f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:38.055175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 726/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 18:32:38 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:32:40.133401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5becec-5ebe-4df4-a110-50d7cfd369a9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:40.133932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5becec-5ebe-4df4-a110-50d7cfd369a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:40.133932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5becec-5ebe-4df4-a110-50d7cfd369a9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:40.135255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 753/1479] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:40.140397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf78f5-aa93-4c73-95f3-5dcbb116699f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:40.140844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf78f5-aa93-4c73-95f3-5dcbb116699f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:40.140954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf78f5-aa93-4c73-95f3-5dcbb116699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:40.158980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9cdf78f5-aa93-4c73-95f3-5dcbb116699f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:40.160203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9cdf78f5-aa93-4c73-95f3-5dcbb116699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:40.167888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 727/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:32:40.209786 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5becec-5ebe-4df4-a110-50d7cfd369a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:40.224578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5becec-5ebe-4df4-a110-50d7cfd369a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:40.229930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de91ac-77ff-4c7d-a295-e2f7fdeb611e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:40.230559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de91ac-77ff-4c7d-a295-e2f7fdeb611e service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:40.230844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de91ac-77ff-4c7d-a295-e2f7fdeb611e service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:40.231120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de91ac-77ff-4c7d-a295-e2f7fdeb611e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:40.240032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de91ac-77ff-4c7d-a295-e2f7fdeb611e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:40.241636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de91ac-77ff-4c7d-a295-e2f7fdeb611e service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:40.251069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 754/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:42.499675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edcc2d-b9bd-47ed-869a-6351bf54d310 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:42.500286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edcc2d-b9bd-47ed-869a-6351bf54d310 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:42.500286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edcc2d-b9bd-47ed-869a-6351bf54d310 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:42.502155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 728/1482] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:42.507638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbbf70-9197-4164-9739-36ee11d1ef79 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:42.508071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbbf70-9197-4164-9739-36ee11d1ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:42.508237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbbf70-9197-4164-9739-36ee11d1ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:42.526382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1cdbbf70-9197-4164-9739-36ee11d1ef79 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:42.527579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1cdbbf70-9197-4164-9739-36ee11d1ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:42.535775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 755/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:42.575863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edcc2d-b9bd-47ed-869a-6351bf54d310 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:42.586908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edcc2d-b9bd-47ed-869a-6351bf54d310 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:42.590363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd717a-df18-4b32-9041-5612e5a66eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:42.590994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd717a-df18-4b32-9041-5612e5a66eab service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:42.591276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd717a-df18-4b32-9041-5612e5a66eab service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:42.591551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd717a-df18-4b32-9041-5612e5a66eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:42.600343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd717a-df18-4b32-9041-5612e5a66eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:42.601793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd717a-df18-4b32-9041-5612e5a66eab service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:42.611361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 729/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:44.708210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4350-956f-458e-ae19-912886be8261 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:44.708779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4350-956f-458e-ae19-912886be8261 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:44.708779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4350-956f-458e-ae19-912886be8261 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:44.710177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 756/1485] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:44.715457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e174771-8b50-4581-8645-aff0b5caf15d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:44.715909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e174771-8b50-4581-8645-aff0b5caf15d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:44.716043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e174771-8b50-4581-8645-aff0b5caf15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:44.735371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5e174771-8b50-4581-8645-aff0b5caf15d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:44.737219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5e174771-8b50-4581-8645-aff0b5caf15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:44.744985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 730/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:32:44.783587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4350-956f-458e-ae19-912886be8261 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:44.794385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4350-956f-458e-ae19-912886be8261 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:44.797873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3686431-dde6-4b9d-903a-31fb293f89e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:44.799143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686431-dde6-4b9d-903a-31fb293f89e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:44.799452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686431-dde6-4b9d-903a-31fb293f89e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:44.799705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686431-dde6-4b9d-903a-31fb293f89e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:44.808595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3686431-dde6-4b9d-903a-31fb293f89e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:44.810040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3686431-dde6-4b9d-903a-31fb293f89e0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:44.819358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 757/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:46.956256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5f627-ae67-48d6-ae56-9ca12a33f0d5 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:46.956796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5f627-ae67-48d6-ae56-9ca12a33f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:46.956796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5f627-ae67-48d6-ae56-9ca12a33f0d5 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:46.958239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 731/1488] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:46.963644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227724-a977-44ed-ae1d-68b1a2e02335 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:46.964082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227724-a977-44ed-ae1d-68b1a2e02335 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:46.964200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227724-a977-44ed-ae1d-68b1a2e02335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:46.981808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a4227724-a977-44ed-ae1d-68b1a2e02335 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:46.982998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a4227724-a977-44ed-ae1d-68b1a2e02335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:46.992221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 758/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:32:47.032103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5f627-ae67-48d6-ae56-9ca12a33f0d5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:47.043261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5f627-ae67-48d6-ae56-9ca12a33f0d5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:47.047128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ac32-b909-4b8e-987f-b6d79722f15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:47.047767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ac32-b909-4b8e-987f-b6d79722f15a service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:47.048087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ac32-b909-4b8e-987f-b6d79722f15a service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:47.048367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ac32-b909-4b8e-987f-b6d79722f15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:47.059053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ac32-b909-4b8e-987f-b6d79722f15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:47.060528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ac32-b909-4b8e-987f-b6d79722f15a service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:47.071147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 732/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:49.336897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68993b56-0b6e-4293-81f2-d33c9e81a1ba None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:49.337432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68993b56-0b6e-4293-81f2-d33c9e81a1ba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:49.337432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68993b56-0b6e-4293-81f2-d33c9e81a1ba None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:49.338744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 759/1491] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 18:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:32:49.344172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec994-9d67-415d-bc2b-9de73580dbc7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:49.344640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec994-9d67-415d-bc2b-9de73580dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:49.344746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec994-9d67-415d-bc2b-9de73580dbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:49.365336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-364ec994-9d67-415d-bc2b-9de73580dbc7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:32:49.366531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-364ec994-9d67-415d-bc2b-9de73580dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:32:49.374163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 733/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 18:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:32:49.413521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68993b56-0b6e-4293-81f2-d33c9e81a1ba None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:32:49.424598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68993b56-0b6e-4293-81f2-d33c9e81a1ba None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:32:49.429212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8db0-5d2a-4a38-815f-5e22a6d45817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:32:49.430253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8db0-5d2a-4a38-815f-5e22a6d45817 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:32:49.430753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8db0-5d2a-4a38-815f-5e22a6d45817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:32:49.431051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8db0-5d2a-4a38-815f-5e22a6d45817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:32:49.440877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8db0-5d2a-4a38-815f-5e22a6d45817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:32:49.442328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8db0-5d2a-4a38-815f-5e22a6d45817 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:32:49.451579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 760/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:32:59.359670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=33 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:59.447528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=33 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:34:16.145093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.145655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.145655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.163996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:34:16.165196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:16.173786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 734/1494] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:34:16.182991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.183475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.183571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.200821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:34:16.201993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:16.209756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 761/1495] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:34:16.214064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.224451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333243de-7189-4de4-af6f-b9add3ad9075 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.228987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.229637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.229921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.230205 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.230937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:34:16.231248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.232291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.232291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:34:16.232291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:34:16.233207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.245600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 735/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:34:16.254100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.263347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c9590-23c8-48c4-bc57-a1031cb58357 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.268103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.268748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.269031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.269306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.269987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.271750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.271750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:34:16.271750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:34:16.272998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.308826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 762/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:34:16 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:34:16.313184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.323199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0888-6a6a-4c03-b89d-5070eb01b297 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.377773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.378432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.378716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.378990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.379688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.380722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.380722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:34:16.380722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:34:16.381962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.402011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 736/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:34:16 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:34:16.405946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.419169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf943a2-fa97-4955-a848-8c2ffc7aec89 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.424804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.425470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.425754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.426031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.426757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.427768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.427768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:34:16.427768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:34:16.428696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.441417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 763/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:34:16.445569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.455512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87a773-05fc-427d-9ab6-1a8201c27936 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.460007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.460659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.460942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.461218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.461938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.462930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.462930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:34:16.462930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:34:16.463817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a5f5b-6a76-4ba8-bece-a349147dd582 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.477840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 737/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:34:16.481966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.492992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68c616-c2ba-4717-af0e-323e84fbc631 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.497502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.498379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.498670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.498947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] PATH_INFO: `/v3/projects/efcf0abeb89a42b6a69a5b42943d2d0f/users/bd846b65e6564998accc41bdd64c25d8/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.514616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcf0abeb89a42b6a69a5b42943d2d0f, user_id=bd846b65e6564998accc41bdd64c25d8, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.515655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.515655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:34:16.515655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:34:16.518702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a60c13-cfc4-46b1-a842-89890edf0c65 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.533023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 764/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:34:16 2022] PUT /identity/v3/projects/efcf0abeb89a42b6a69a5b42943d2d0f/users/bd846b65e6564998accc41bdd64c25d8/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:34:16.544315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec60d6-b76c-4014-aee1-ad7864ea7dca None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.544608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec60d6-b76c-4014-aee1-ad7864ea7dca None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.544889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec60d6-b76c-4014-aee1-ad7864ea7dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.570842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2dec60d6-b76c-4014-aee1-ad7864ea7dca None None] MFA Rules not processed for user `bd846b65e6564998accc41bdd64c25d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:34:16.572071 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2dec60d6-b76c-4014-aee1-ad7864ea7dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:16.634118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 738/1502] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:34:16.647788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79541423-fbcd-49fd-8445-6067aad1768b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.648117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79541423-fbcd-49fd-8445-6067aad1768b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.648401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79541423-fbcd-49fd-8445-6067aad1768b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.649769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 765/1503] 10.222.0.18 () {54 vars in 963 bytes} [Wed Jun 22 18:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:34:16.654604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a80ba-13c2-4ba1-811d-6a2c94e188b3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.654836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a80ba-13c2-4ba1-811d-6a2c94e188b3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.655112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a80ba-13c2-4ba1-811d-6a2c94e188b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.673332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-aa8a80ba-13c2-4ba1-811d-6a2c94e188b3 None None] MFA Rules not processed for user `01bb9cc9e4c34504ac6574c28963b4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:34:16.674518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-aa8a80ba-13c2-4ba1-811d-6a2c94e188b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:16.724962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:34:16.733821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 739/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Jun 22 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:34:16.741656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79541423-fbcd-49fd-8445-6067aad1768b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.752646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79541423-fbcd-49fd-8445-6067aad1768b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.756269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.756967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.757508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.757790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.766885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.768184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.777189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 766/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:34:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:34:16.820336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cecdf0-ba9e-426c-9fc8-430cf88b8899 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.820627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cecdf0-ba9e-426c-9fc8-430cf88b8899 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.820900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cecdf0-ba9e-426c-9fc8-430cf88b8899 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.822249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 740/1506] 10.222.0.18 () {52 vars in 829 bytes} [Wed Jun 22 18:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:34:16.825765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:16.886287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9247c-9ebf-48c0-81f2-59301b74a718 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:16.890754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:16.891642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:16.891952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:16.892231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] PATH_INFO: `/v3/users/bd846b65e6564998accc41bdd64c25d8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:16.893415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd846b65e6564998accc41bdd64c25d8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:16.894428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:16.894428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:34:16.894428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:34:16.895674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:16.958402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd846b65e6564998accc41bdd64c25d8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:16.977700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd846b65e6564998accc41bdd64c25d8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:16.987621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd846b65e6564998accc41bdd64c25d8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:16.988310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd846b65e6564998accc41bdd64c25d8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:16.998406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:34:17.003812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd846b65e6564998accc41bdd64c25d8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:17.011329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 767/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:34:16 2022] DELETE /identity/v3/users/bd846b65e6564998accc41bdd64c25d8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:34:17.016513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:17.016513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:17.016863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:17.034474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:34:17.035665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:17.093208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 741/1508] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:34:17.103298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:17.104775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:17.161428 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eed18-4aa0-44ae-88a8-a552837bd19b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:17.164994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64f078-b32b-48ff-abc2-1af3bae4e36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:17.165640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64f078-b32b-48ff-abc2-1af3bae4e36e service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:17.165930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64f078-b32b-48ff-abc2-1af3bae4e36e service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:17.166213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64f078-b32b-48ff-abc2-1af3bae4e36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:17.175592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64f078-b32b-48ff-abc2-1af3bae4e36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:17.177084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64f078-b32b-48ff-abc2-1af3bae4e36e service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:17.186330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 768/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:34:17.519134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:34:17.520636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:34:17.533236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8fc21-b808-4392-893a-efed8dd0e639 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:34:17.538158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:34:17.539021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:34:17.539305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:34:17.539706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] PATH_INFO: `/v3/projects/efcf0abeb89a42b6a69a5b42943d2d0f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:34:17.540801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcf0abeb89a42b6a69a5b42943d2d0f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:34:17.541819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:34:17.541819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:34:17.541819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:34:17.543042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:34:17.604128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcf0abeb89a42b6a69a5b42943d2d0f', 'request_id': 'req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:17.617086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcf0abeb89a42b6a69a5b42943d2d0f', 'request_id': 'req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:17.623185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcf0abeb89a42b6a69a5b42943d2d0f', 'request_id': 'req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:17.637637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] The token cache is being invalidate because project efcf0abeb89a42b6a69a5b42943d2d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:34:17.637927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:17.638862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0aede7cb-fe16-438f-8d7a-dfa55e082a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:34:17.640355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 742/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:34:17 2022] DELETE /identity/v3/projects/efcf0abeb89a42b6a69a5b42943d2d0f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:34:27.182284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=29 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:34:27.634637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:35:51.167053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103557-02be-4abd-a475-0bd2a6f19a41 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:51.167524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103557-02be-4abd-a475-0bd2a6f19a41 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:51.167627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103557-02be-4abd-a475-0bd2a6f19a41 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:51.169035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:35:51.174564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5a71-b49c-4b57-9360-95224cd1bbee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:51.175027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5a71-b49c-4b57-9360-95224cd1bbee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:51.175134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5a71-b49c-4b57-9360-95224cd1bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:51.194014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4f4a5a71-b49c-4b57-9360-95224cd1bbee None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:35:51.195246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4f4a5a71-b49c-4b57-9360-95224cd1bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:35:51.253381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:35:51.412967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103557-02be-4abd-a475-0bd2a6f19a41 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:35:51.414660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5b103557-02be-4abd-a475-0bd2a6f19a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:35:51.489873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103557-02be-4abd-a475-0bd2a6f19a41 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:35:51.495270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f405d3-5ff7-4bf1-a07f-c07b26b9d544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:35:51.495947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f405d3-5ff7-4bf1-a07f-c07b26b9d544 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:51.496239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f405d3-5ff7-4bf1-a07f-c07b26b9d544 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:51.496522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f405d3-5ff7-4bf1-a07f-c07b26b9d544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:51.504731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f405d3-5ff7-4bf1-a07f-c07b26b9d544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:35:51.506398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f405d3-5ff7-4bf1-a07f-c07b26b9d544 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:35:51.516327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 770/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:35:52.391666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e23e-b610-4c71-8c9b-b4cee36eb84c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:52.392272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e23e-b610-4c71-8c9b-b4cee36eb84c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:52.392272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e23e-b610-4c71-8c9b-b4cee36eb84c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:52.393667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:35:52.398513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a161f-843f-43fa-b1ed-9fab69c95f4a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:52.398921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a161f-843f-43fa-b1ed-9fab69c95f4a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:52.399123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a161f-843f-43fa-b1ed-9fab69c95f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:52.417994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9c1a161f-843f-43fa-b1ed-9fab69c95f4a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:35:52.419196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c1a161f-843f-43fa-b1ed-9fab69c95f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:35:52.428901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:35:52.582507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e23e-b610-4c71-8c9b-b4cee36eb84c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:35:52.597474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e23e-b610-4c71-8c9b-b4cee36eb84c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:35:52.602743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eff16-4c89-4096-9124-618b5836bce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:35:52.603369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eff16-4c89-4096-9124-618b5836bce0 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:52.603653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eff16-4c89-4096-9124-618b5836bce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:52.603960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eff16-4c89-4096-9124-618b5836bce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:52.612043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eff16-4c89-4096-9124-618b5836bce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:35:52.613634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eff16-4c89-4096-9124-618b5836bce0 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:35:52.622788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 745/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:35:53.810413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe244-c904-4c6d-9b9f-a2004fb82e19 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:53.810933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe244-c904-4c6d-9b9f-a2004fb82e19 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:53.811129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe244-c904-4c6d-9b9f-a2004fb82e19 None None] PATH_INFO: `/v3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:53.812891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 772/1517] 10.222.0.44 () {54 vars in 925 bytes} [Wed Jun 22 18:35:53 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:35:53.818994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34193c-54cb-44cd-9e58-03e739fb522e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:53.819425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34193c-54cb-44cd-9e58-03e739fb522e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:53.819561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34193c-54cb-44cd-9e58-03e739fb522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:53.837642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0a34193c-54cb-44cd-9e58-03e739fb522e None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:35:53.838858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0a34193c-54cb-44cd-9e58-03e739fb522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:35:53.900481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 746/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Wed Jun 22 18:35:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:35:57.693597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ec8d-45e0-43f0-9b1d-8ea9da840e25 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:57.694175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ec8d-45e0-43f0-9b1d-8ea9da840e25 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:57.694175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ec8d-45e0-43f0-9b1d-8ea9da840e25 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:57.695461 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 773/1519] 10.222.0.18 () {54 vars in 960 bytes} [Wed Jun 22 18:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:35:57.700287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c59c0-e43a-4758-99ac-b086007a9bcf None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:57.700743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c59c0-e43a-4758-99ac-b086007a9bcf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:57.700846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c59c0-e43a-4758-99ac-b086007a9bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:57.719554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6b0c59c0-e43a-4758-99ac-b086007a9bcf None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:35:57.720775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6b0c59c0-e43a-4758-99ac-b086007a9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:35:57.729122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 747/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Wed Jun 22 18:35:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:35:57.736963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398ec8d-45e0-43f0-9b1d-8ea9da840e25 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:35:57.750046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398ec8d-45e0-43f0-9b1d-8ea9da840e25 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:35:57.755093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5b22-012f-4ab8-81f1-ab4478aea97b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:35:57.755726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5b22-012f-4ab8-81f1-ab4478aea97b service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:35:57.756060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5b22-012f-4ab8-81f1-ab4478aea97b service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:35:57.756337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5b22-012f-4ab8-81f1-ab4478aea97b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:35:57.765592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5b22-012f-4ab8-81f1-ab4478aea97b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:35:57.767623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5b22-012f-4ab8-81f1-ab4478aea97b service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:35:57.777494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 774/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:35:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:03.894077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972df1-bcee-4fb9-8244-db031c8301e7 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:03.894661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972df1-bcee-4fb9-8244-db031c8301e7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:03.894661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972df1-bcee-4fb9-8244-db031c8301e7 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:03.896063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:36:03.900890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c49c-6388-49cc-8f44-74b97cab3458 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:03.901300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c49c-6388-49cc-8f44-74b97cab3458 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:03.901444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c49c-6388-49cc-8f44-74b97cab3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:03.919111 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d4d1c49c-6388-49cc-8f44-74b97cab3458 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:36:03.920285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d4d1c49c-6388-49cc-8f44-74b97cab3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:03.928612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:36:04.086244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972df1-bcee-4fb9-8244-db031c8301e7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:36:04.101366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972df1-bcee-4fb9-8244-db031c8301e7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:36:04.106691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9f3f8-f391-47be-bdf2-2230dac27c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:36:04.107328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9f3f8-f391-47be-bdf2-2230dac27c2b service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:04.107613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9f3f8-f391-47be-bdf2-2230dac27c2b service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:04.107917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9f3f8-f391-47be-bdf2-2230dac27c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:04.117695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9f3f8-f391-47be-bdf2-2230dac27c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:36:04.119310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9f3f8-f391-47be-bdf2-2230dac27c2b service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:36:04.129354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 749/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:04.945422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34acf6-e2b3-4cb6-8c05-ae364e4b6a99 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:04.945985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34acf6-e2b3-4cb6-8c05-ae364e4b6a99 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:04.945985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34acf6-e2b3-4cb6-8c05-ae364e4b6a99 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:04.947348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:36:04.952069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05bd67-13dc-4c0d-8606-b7cfdf1f00c8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:04.952517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05bd67-13dc-4c0d-8606-b7cfdf1f00c8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:04.952625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05bd67-13dc-4c0d-8606-b7cfdf1f00c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:04.971414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2d05bd67-13dc-4c0d-8606-b7cfdf1f00c8 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:36:04.972667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2d05bd67-13dc-4c0d-8606-b7cfdf1f00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:04.980568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 18:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:36:05.133469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34acf6-e2b3-4cb6-8c05-ae364e4b6a99 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:36:05.148037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34acf6-e2b3-4cb6-8c05-ae364e4b6a99 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:36:05.154066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed69f7-f728-464b-a7e8-6514d00aad8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:36:05.154703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed69f7-f728-464b-a7e8-6514d00aad8a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:05.154990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed69f7-f728-464b-a7e8-6514d00aad8a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:05.155270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed69f7-f728-464b-a7e8-6514d00aad8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:05.164683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed69f7-f728-464b-a7e8-6514d00aad8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:36:05.166562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed69f7-f728-464b-a7e8-6514d00aad8a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:36:05.178348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 777/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:09.029685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd275c2-d55d-4db2-a522-e911508f49fe None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:09.030222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd275c2-d55d-4db2-a522-e911508f49fe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:09.030222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd275c2-d55d-4db2-a522-e911508f49fe None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:09.031707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:36:09.037326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797554-b5dd-4a03-b137-442338d63232 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:09.037749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797554-b5dd-4a03-b137-442338d63232 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:09.037892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797554-b5dd-4a03-b137-442338d63232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:09.056321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-43797554-b5dd-4a03-b137-442338d63232 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:36:09.057528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43797554-b5dd-4a03-b137-442338d63232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:09.066064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:36:09.101667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd275c2-d55d-4db2-a522-e911508f49fe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:36:09.103316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7bd275c2-d55d-4db2-a522-e911508f49fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:09.160274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd275c2-d55d-4db2-a522-e911508f49fe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:36:09.163785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe0c0c-43ac-44f9-85ba-0b3ae2ecbd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:36:09.164482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe0c0c-43ac-44f9-85ba-0b3ae2ecbd97 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:09.164767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe0c0c-43ac-44f9-85ba-0b3ae2ecbd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:09.165045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe0c0c-43ac-44f9-85ba-0b3ae2ecbd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:09.174584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe0c0c-43ac-44f9-85ba-0b3ae2ecbd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:36:09.176042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe0c0c-43ac-44f9-85ba-0b3ae2ecbd97 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:36:09.180921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:36:09.186012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 752/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:11.204975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f4f9c-ce1c-4ee8-80b3-0ff84748b1b8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:11.205462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f4f9c-ce1c-4ee8-80b3-0ff84748b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:11.205589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f4f9c-ce1c-4ee8-80b3-0ff84748b1b8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:11.206926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:36:11.212030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790aea83-1564-4481-b34c-d18474af5b16 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:11.212465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790aea83-1564-4481-b34c-d18474af5b16 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:11.212603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790aea83-1564-4481-b34c-d18474af5b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:11.230967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-790aea83-1564-4481-b34c-d18474af5b16 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:36:11.232186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-790aea83-1564-4481-b34c-d18474af5b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:11.239886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:36:11.275963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f4f9c-ce1c-4ee8-80b3-0ff84748b1b8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:36:11.287230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f4f9c-ce1c-4ee8-80b3-0ff84748b1b8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:36:11.290716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db7668-b8b0-4e57-8930-c592c5df5622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:36:11.291359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db7668-b8b0-4e57-8930-c592c5df5622 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:11.291642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db7668-b8b0-4e57-8930-c592c5df5622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:11.291953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db7668-b8b0-4e57-8930-c592c5df5622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:11.300788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db7668-b8b0-4e57-8930-c592c5df5622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:36:11.302235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db7668-b8b0-4e57-8930-c592c5df5622 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:36:11.311510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 780/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:14.773752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb03885-bcac-40a6-8c31-4fb75989f718 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:14.774160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb03885-bcac-40a6-8c31-4fb75989f718 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:14.774304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb03885-bcac-40a6-8c31-4fb75989f718 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:14.775717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:36:14.781668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5182-9336-44c8-950e-baa832e7a305 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:14.782074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5182-9336-44c8-950e-baa832e7a305 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:14.782222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5182-9336-44c8-950e-baa832e7a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:14.800247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-626b5182-9336-44c8-950e-baa832e7a305 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:36:14.801431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-626b5182-9336-44c8-950e-baa832e7a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:14.809101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:36:15.112456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb03885-bcac-40a6-8c31-4fb75989f718 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:36:15.114150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1cb03885-bcac-40a6-8c31-4fb75989f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:15.172222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb03885-bcac-40a6-8c31-4fb75989f718 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:36:15.175663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9b50-00f7-4f37-86a7-40bdedc948a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:36:15.176333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9b50-00f7-4f37-86a7-40bdedc948a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:15.176615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9b50-00f7-4f37-86a7-40bdedc948a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:15.176888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9b50-00f7-4f37-86a7-40bdedc948a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:15.185514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9b50-00f7-4f37-86a7-40bdedc948a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:36:15.186967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9b50-00f7-4f37-86a7-40bdedc948a3 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:36:15.196227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 755/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:17.272096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f083b4-7418-4fab-85fc-60a0109a4318 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:17.272653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f083b4-7418-4fab-85fc-60a0109a4318 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:17.272653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f083b4-7418-4fab-85fc-60a0109a4318 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:17.274055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 18:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:36:17.279266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab17e7-5141-4fd7-9799-ec36030c9870 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:17.279684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab17e7-5141-4fd7-9799-ec36030c9870 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:17.279851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab17e7-5141-4fd7-9799-ec36030c9870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:17.302254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-78ab17e7-5141-4fd7-9799-ec36030c9870 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:36:17.303451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-78ab17e7-5141-4fd7-9799-ec36030c9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:17.311317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 18:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:36:17.612512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f083b4-7418-4fab-85fc-60a0109a4318 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:36:17.614202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-23f083b4-7418-4fab-85fc-60a0109a4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:36:17.621750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=65 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:36:17.628254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f083b4-7418-4fab-85fc-60a0109a4318 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:36:17.631772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15fc86-30ac-4824-ab6e-5579f6a11e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:36:17.632442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15fc86-30ac-4824-ab6e-5579f6a11e50 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:36:17.632730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15fc86-30ac-4824-ab6e-5579f6a11e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:36:17.633016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15fc86-30ac-4824-ab6e-5579f6a11e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:36:17.642210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15fc86-30ac-4824-ab6e-5579f6a11e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:36:17.643649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15fc86-30ac-4824-ab6e-5579f6a11e50 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:36:17.653053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 783/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:36:27.296529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=32 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:36:27.648931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:44.044388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.046422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.046930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.072830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.074438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.087158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 757/1540] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.097793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.098402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.098402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.123577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.125009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.134983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 784/1541] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.141226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.159054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a35d7-53ed-4793-888a-0852acfcb3ee None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.169177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.170834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.176041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.176622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.177668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:44.178209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.180155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894a05b-41ca-42d3-8828-0a35a904851c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.193888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 758/1542] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:44.203919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.222109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387e3de-bdc7-435c-81d3-9cda4fe7ffb0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.230829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.231946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.232485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.233347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.234460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.236701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.268929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b83a0-f212-4a1f-af0a-cfeaa14d1b18 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.270034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b83a0-f212-4a1f-af0a-cfeaa14d1b18 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.270529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b83a0-f212-4a1f-af0a-cfeaa14d1b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.309929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 785/1543] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:44.311735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a74b83a0-f212-4a1f-af0a-cfeaa14d1b18 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.317089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.318635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a74b83a0-f212-4a1f-af0a-cfeaa14d1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.426511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 759/1544] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:37:44.439091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.439768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.440320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.465580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3d82-6fe4-4908-8eec-3ec65afa7c4f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.468765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.470231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.475280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.475995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.476280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.476555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.477360 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.478393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:37:44.478393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:37:44.478393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:37:44.479802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.488423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 760/1545] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:37:44.494394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.512271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f0bf-a0d5-4feb-b5ee-97a31f96ac98 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.530547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 786/1546] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:44.531140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.531859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.532150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.532436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.533330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:44.533520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.535220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.540539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.563403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 761/1547] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:37:44.568206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738270dc-73fd-4f11-bb78-b1f17e6fe791 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.574954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.587097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67ccf4-42d3-445d-8c2b-da2a78a23593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.587483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67ccf4-42d3-445d-8c2b-da2a78a23593 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.587756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67ccf4-42d3-445d-8c2b-da2a78a23593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.588064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67ccf4-42d3-445d-8c2b-da2a78a23593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.588815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67ccf4-42d3-445d-8c2b-da2a78a23593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.590463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67ccf4-42d3-445d-8c2b-da2a78a23593 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.593950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fe0a9-99fc-4271-a1ba-d15470477cea admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.611714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.612448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.612741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.613019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.613741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.614795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:37:44.614795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:37:44.614795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:37:44.616393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0bfac-0a24-4f36-8975-3c4644a1f81e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.620066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 787/1548] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:44.621215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.621509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.621847 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.677127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.678472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.687622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 762/1549] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:44.689006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.689260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.689551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.695994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 788/1550] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.696856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.715438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaedb7-15c2-4f47-a14e-5d61361f81ca None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.730553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.731862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.852036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 763/1551] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.852219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b202c-8bbf-482b-a47e-832274ab3a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.852219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b202c-8bbf-482b-a47e-832274ab3a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.852409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.852500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b202c-8bbf-482b-a47e-832274ab3a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.852500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b202c-8bbf-482b-a47e-832274ab3a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.852500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b202c-8bbf-482b-a47e-832274ab3a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.853861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b202c-8bbf-482b-a47e-832274ab3a55 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.864255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996201-a214-4a63-9e74-640fc1bca289 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.865156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 789/1552] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:44.866576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934035-1f50-4f02-a111-a5c185a1ba19 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.866947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934035-1f50-4f02-a111-a5c185a1ba19 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.867306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934035-1f50-4f02-a111-a5c185a1ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.872705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec23d0-3cbb-4ae8-acbd-150466bae78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.874659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec23d0-3cbb-4ae8-acbd-150466bae78e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.874964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec23d0-3cbb-4ae8-acbd-150466bae78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.875250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec23d0-3cbb-4ae8-acbd-150466bae78e admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.875994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec23d0-3cbb-4ae8-acbd-150466bae78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.877955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec23d0-3cbb-4ae8-acbd-150466bae78e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.888301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a7934035-1f50-4f02-a111-a5c185a1ba19 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.890273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a7934035-1f50-4f02-a111-a5c185a1ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.899235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 790/1553] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.900749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407af2f-1374-4557-9c64-3fa218125b68 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.901050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407af2f-1374-4557-9c64-3fa218125b68 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.908078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407af2f-1374-4557-9c64-3fa218125b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.908216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 764/1554] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:44.908216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76ffd-7212-404c-8085-2cd3e5976a1f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.908216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76ffd-7212-404c-8085-2cd3e5976a1f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.908216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76ffd-7212-404c-8085-2cd3e5976a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.925453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b407af2f-1374-4557-9c64-3fa218125b68 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.926662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b407af2f-1374-4557-9c64-3fa218125b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.928986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3fd76ffd-7212-404c-8085-2cd3e5976a1f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.930168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3fd76ffd-7212-404c-8085-2cd3e5976a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.934665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 791/1555] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.936536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.936828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.937177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.939430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 765/1556] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.941267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.941900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.942414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.960522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.961256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:44.961733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.962575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:44.970139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 792/1557] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.970882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 766/1558] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:44.971559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.974480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:44.983879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8c976-2286-4fc6-94ba-ae57f28d091c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.986762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bff12-148f-4102-8146-43933a86f00c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:44.988528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.989184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.989473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.989754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.990483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:44.990796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:44.991588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa37ae-7d20-4a6d-8c4f-ed21a2b45be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:44.992461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:44.992565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa37ae-7d20-4a6d-8c4f-ed21a2b45be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:44.992778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa37ae-7d20-4a6d-8c4f-ed21a2b45be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:44.993059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa37ae-7d20-4a6d-8c4f-ed21a2b45be4 admin admin] PATH_INFO: `/v3/projects/f3edb8dc4f1946dc985dd1c0fb510c07/users/562ad996aece4a77a551a9a673cce958/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:44.994900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.006076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 767/1559] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:45.006897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.012217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa37ae-7d20-4a6d-8c4f-ed21a2b45be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3edb8dc4f1946dc985dd1c0fb510c07, user_id=562ad996aece4a77a551a9a673cce958, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.015110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa37ae-7d20-4a6d-8c4f-ed21a2b45be4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.017458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6838-da30-4d29-87dc-f644b3fff56a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.018330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.022688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8591b-f25d-4452-abf2-3ef3e7e1bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.023564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8591b-f25d-4452-abf2-3ef3e7e1bec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.024023 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8591b-f25d-4452-abf2-3ef3e7e1bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.024531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8591b-f25d-4452-abf2-3ef3e7e1bec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.025355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8591b-f25d-4452-abf2-3ef3e7e1bec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.027073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8591b-f25d-4452-abf2-3ef3e7e1bec1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.029719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 793/1560] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:44 2022] PUT /identity/v3/projects/f3edb8dc4f1946dc985dd1c0fb510c07/users/562ad996aece4a77a551a9a673cce958/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:45.030989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4130c49-777f-4f0e-a45b-80d71c61534d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.031278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4130c49-777f-4f0e-a45b-80d71c61534d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.031555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4130c49-777f-4f0e-a45b-80d71c61534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.049737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 768/1561] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:45.049737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be371-df99-4997-976a-8490df643d5a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.049737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be371-df99-4997-976a-8490df643d5a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.049737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be371-df99-4997-976a-8490df643d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.050634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c4130c49-777f-4f0e-a45b-80d71c61534d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.051232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c4130c49-777f-4f0e-a45b-80d71c61534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.067088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-361be371-df99-4997-976a-8490df643d5a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.068321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-361be371-df99-4997-976a-8490df643d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.110809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 794/1562] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.111811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4515a-cfed-4d3b-91b5-b29430ce4247 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.112133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4515a-cfed-4d3b-91b5-b29430ce4247 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.112414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4515a-cfed-4d3b-91b5-b29430ce4247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.130363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-93c4515a-cfed-4d3b-91b5-b29430ce4247 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.131556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-93c4515a-cfed-4d3b-91b5-b29430ce4247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.134218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 769/1563] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.135092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361be371-df99-4997-976a-8490df643d5a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.143877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 795/1564] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.145259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361be371-df99-4997-976a-8490df643d5a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.145396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb23f-d123-45e9-85ab-ef8f7134ec18 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.145755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb23f-d123-45e9-85ab-ef8f7134ec18 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.146111 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb23f-d123-45e9-85ab-ef8f7134ec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.151402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.152083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.152374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.152655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.153387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:45.153723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.155562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.163745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2f2eb23f-d123-45e9-85ab-ef8f7134ec18 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.164961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2f2eb23f-d123-45e9-85ab-ef8f7134ec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.171890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 770/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:45.171890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.177082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 796/1566] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.178343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55390d-0bd8-4dbb-80d3-b1a3ed98ebee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.178640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55390d-0bd8-4dbb-80d3-b1a3ed98ebee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.178923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55390d-0bd8-4dbb-80d3-b1a3ed98ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.182281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1692-8de5-4839-b705-8c678186803d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.187535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.188251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.188541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.188823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.189547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.191483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.205153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5a55390d-0bd8-4dbb-80d3-b1a3ed98ebee None None] MFA Rules not processed for user `562ad996aece4a77a551a9a673cce958`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.206369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5a55390d-0bd8-4dbb-80d3-b1a3ed98ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.219637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 771/1567] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.221172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.274563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 797/1568] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.275868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.276160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.276572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.285533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1910bd-5f2b-4083-933d-90cf40137b16 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.290167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.290829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.291112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.291386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.292151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.293744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.297017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.298220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.305786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 772/1569] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:45.306789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.306908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 798/1570] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.307619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.318813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeae093-8be4-4450-b3bc-6be5fbed2f0a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.323562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e72c8-f0e8-48b2-a4f7-6b62b29da2d2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.324118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.324846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.325276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.325529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.326513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:45.326634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.327649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:37:45.327649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:37:45.327649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:37:45.328606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.329280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.329996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.330290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.330563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.331291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:45.331595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.333224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.348600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 799/1571] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:45.348600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.348876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 773/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:45.348876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.355341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1a97-7f4f-4645-af19-dd49c51a6799 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.358586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726eed-0983-46e8-9937-c87608600653 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.361020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854221-f8b0-47a6-8a02-939ec4e8997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.361622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854221-f8b0-47a6-8a02-939ec4e8997e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.361915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854221-f8b0-47a6-8a02-939ec4e8997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.362193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854221-f8b0-47a6-8a02-939ec4e8997e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.362883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854221-f8b0-47a6-8a02-939ec4e8997e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.363111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.363735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.364055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.364339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.364932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854221-f8b0-47a6-8a02-939ec4e8997e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.365063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:45.365387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.366970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.378705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 774/1573] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:45.379731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.390214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e71a42-a259-4818-9761-813083b60f16 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.395061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.395713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.396040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.396322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.397011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.400483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 800/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.400642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.400736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4942f4-33fd-4b5f-91cd-7b4521ce0597 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.400736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4942f4-33fd-4b5f-91cd-7b4521ce0597 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.400736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4942f4-33fd-4b5f-91cd-7b4521ce0597 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.400965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 801/1575] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 18:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:37:45.405895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4942f4-33fd-4b5f-91cd-7b4521ce0597 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.419695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 775/1576] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.423566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.428390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.433318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895679a7-a92a-4faa-a590-f04b1e349b60 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.442331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.474592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4942f4-33fd-4b5f-91cd-7b4521ce0597 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.479145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.480097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.480388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.480670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] PATH_INFO: `/v3/projects/61c31a31afc94f8688241b713ec3e892/users/3eae8de1576148ed83eaf66da7971818/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.491854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.492626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.492960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.493239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.493960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:45.494270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.495063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c31a31afc94f8688241b713ec3e892, user_id=3eae8de1576148ed83eaf66da7971818, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.495884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.497817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.508921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 776/1577] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:45.509846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.519186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 802/1578] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:45 2022] PUT /identity/v3/projects/61c31a31afc94f8688241b713ec3e892/users/3eae8de1576148ed83eaf66da7971818/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:45.520286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.525394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863178-d0c1-482a-b989-67a4e25fe415 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.582839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7c16c-a476-4085-8017-3647758ea9ca admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.587717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.588400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.588683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.588957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.589672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.591607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.592312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.593039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.593339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.593621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.594313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.596274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.620880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 803/1579] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.624705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 777/1580] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.624705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.625466 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.691350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caa98-e3fb-4c3b-af7a-b171ddc8157d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.692261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a45363-25fa-41f4-af7d-e081dfcac73c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.696044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da1d71-d32d-41f7-b558-b0e02602f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.696702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1d71-d32d-41f7-b558-b0e02602f88d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.696985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1d71-d32d-41f7-b558-b0e02602f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.697105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.697260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1d71-d32d-41f7-b558-b0e02602f88d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.697658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.697942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da1d71-d32d-41f7-b558-b0e02602f88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.698045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.698224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.699045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.699935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da1d71-d32d-41f7-b558-b0e02602f88d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.701009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.721051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 804/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.722738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.723203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.723615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.734506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 778/1582] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.735581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.742900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.744254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.744559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.776157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.807325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6cfd5-708d-4ebc-89bf-e241277dc786 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.813749 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c220f85-a1eb-4ad0-b815-b2bd67bf8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.814419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c220f85-a1eb-4ad0-b815-b2bd67bf8578 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.814709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c220f85-a1eb-4ad0-b815-b2bd67bf8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.815002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c220f85-a1eb-4ad0-b815-b2bd67bf8578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.815735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c220f85-a1eb-4ad0-b815-b2bd67bf8578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.817397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c220f85-a1eb-4ad0-b815-b2bd67bf8578 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.827140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 805/1583] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.831324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 779/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:45.831476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.831585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.831585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.831585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.840769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730d22-b557-4952-9302-4cea9cbbd24f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.846631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.847289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.847582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.847892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.848344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:45.848590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.849571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:45.850561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.857193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 780/1585] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:45.858105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.867581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff80dd-dfba-4446-8396-e29c00c701a6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.872825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.874253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.874544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.874834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.875531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.877511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.883695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 806/1586] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.883695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.898983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 781/1587] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.899798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.910569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681566f-6bcd-4e26-9eb4-d5b8ddd1a217 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.946958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab660d-b5d2-4934-a706-de648ee89375 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.952078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.952919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.953203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.953478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.954163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.956156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.968233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.969069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.969358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.969669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.970531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.972266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:45.979977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 807/1588] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:45.979977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.982600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 782/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:45.983578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:45.989804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec551-8a61-419d-903b-9e6e171a0882 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.994862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b72b94-38e9-4996-ac32-400ac74c3374 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:45.994987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:45.995533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:45.995814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:45.996124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:45.996861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:45.999408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.000092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.000757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.001030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.001311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.002070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.003671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.015294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 783/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.016331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.027173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 808/1591] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:45 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:46.027173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.081747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.082314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03de43-23e6-4b02-bd48-f71af4c540e1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.087557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.088208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9732-b038-43c7-9b28-28041563d2cd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.088670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.089587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.089883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.094514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.095161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.095450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.095733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.099893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.101379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.110934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 809/1592] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:46.111791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.120884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c848310-12a9-41fb-b1e4-f977fc38c5ec service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.141502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.142319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.142694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.143034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.144067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.147132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.158378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.160189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.163116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.172477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 784/1593] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:46.180467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 810/1594] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:46 2022] POST /identity/v3/users => generated 285 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:46.182146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.192876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.198837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3e03-7b7a-4a3b-9a89-32ac85cd9acc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.209142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.211104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.211629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e5cdc-f4d7-4b41-8664-44fffda22f63 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.212114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.213179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.215246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.217027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.217880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.218236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.218614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.219417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.220739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.221226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.235405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 785/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.235405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.248707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 811/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.248707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.255426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc973d-a328-45b3-b4b2-c9c1d4dec7d0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.261534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.262301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.262655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.262985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c913ad2-cf5d-4ce5-af56-7a2021052b6d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.263111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.263937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.265927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.270894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.272160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.273148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.273612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] PATH_INFO: `/v3/projects/bd1ef211ea584b0abd50b02208966d7a/users/8978ed54252843f78b0d00d37b475ad2/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.282127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 786/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.282127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.293438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3cb16-d7a8-4631-b164-f16f6f8f952c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.297546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1ef211ea584b0abd50b02208966d7a, user_id=8978ed54252843f78b0d00d37b475ad2, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.299547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.300589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.301027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.301177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.301512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.302472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.304455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.321050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 787/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.322181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.331942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 812/1599] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:46 2022] PUT /identity/v3/projects/bd1ef211ea584b0abd50b02208966d7a/users/8978ed54252843f78b0d00d37b475ad2/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:46.333479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.349961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162fea-7731-41a3-8f6a-b507b3d56444 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.414780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818aed-57f5-41e7-a309-cfbda3b34a81 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.426661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.427363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.427653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.428113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.428876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.431009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.452284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 813/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.453531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.454778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.455641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.456135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.456727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.458354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.461522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.465235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e904-b2d6-4443-9752-943dfb6f5954 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.470856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.471709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.472845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.473145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.473907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.475667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.485147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 788/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.485147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.495166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 814/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.499243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.503177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e5e8e-922f-48d6-bff4-e58ea3ecb066 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.510240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3de79-da73-49e6-9fe5-b4e819311067 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.510855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.512211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.512787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.513214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] PATH_INFO: `/v3/projects/d866c4a659e74e42a3c37050eae82229/users/94d5713dc97f442f916b22d925c35042/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.515652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba454c-d2e3-4624-93c1-eaf5ccf91263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.516354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba454c-d2e3-4624-93c1-eaf5ccf91263 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.516785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba454c-d2e3-4624-93c1-eaf5ccf91263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.516903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba454c-d2e3-4624-93c1-eaf5ccf91263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.517644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba454c-d2e3-4624-93c1-eaf5ccf91263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.519293 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba454c-d2e3-4624-93c1-eaf5ccf91263 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.533021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 815/1603] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.534338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.534637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.534922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.540908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d866c4a659e74e42a3c37050eae82229, user_id=94d5713dc97f442f916b22d925c35042, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.543442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:37:46.543442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:37:46.543442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:37:46.546233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.554374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:46.555721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:46.565947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 789/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:46 2022] PUT /identity/v3/projects/d866c4a659e74e42a3c37050eae82229/users/94d5713dc97f442f916b22d925c35042/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:46.567081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.644159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.648560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 816/1605] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:46.649628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.669750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c7d9b-5556-4908-9cbb-113151d0eb32 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.673940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ec25-040d-4e3b-b102-e4375e54a583 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.677614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.678908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.679473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.679629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.680108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.680718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.681010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.681334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] PATH_INFO: `/v3/projects/966e6f6793f54469984c1edc47fb9437/users/5e181ccfa7114f829b8a45397f39c99a/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.681604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.683850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.704411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 817/1606] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:46.704411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.709956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=966e6f6793f54469984c1edc47fb9437, user_id=5e181ccfa7114f829b8a45397f39c99a, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.712707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.713153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef790c-89e7-4c6e-a08b-a99202d023df admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.718974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cccf8-1b3a-41e2-95f8-3423c8d2e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.720054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cccf8-1b3a-41e2-95f8-3423c8d2e11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.720353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cccf8-1b3a-41e2-95f8-3423c8d2e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.720664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cccf8-1b3a-41e2-95f8-3423c8d2e11b admin admin] PATH_INFO: `/v3/projects/b91b10b850024bae8e0d76aa9628224d/users/d32582f1a1994e3b9c05f56185d0079d/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.736245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 790/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:46 2022] PUT /identity/v3/projects/966e6f6793f54469984c1edc47fb9437/users/5e181ccfa7114f829b8a45397f39c99a/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:46.736245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.750488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cccf8-1b3a-41e2-95f8-3423c8d2e11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91b10b850024bae8e0d76aa9628224d, user_id=d32582f1a1994e3b9c05f56185d0079d, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.757816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cccf8-1b3a-41e2-95f8-3423c8d2e11b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.775689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.782796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 818/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:46 2022] PUT /identity/v3/projects/b91b10b850024bae8e0d76aa9628224d/users/d32582f1a1994e3b9c05f56185d0079d/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:46.784765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.785675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.786871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.808238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:46.809932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:46.836911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6c8b-63ac-4c24-b805-9f4d104ae11d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:46.885248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 819/1609] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:46.886114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.906552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:46.907379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:46.907666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:46.907980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] PATH_INFO: `/v3/projects/d348350b964044d8a220056f10ed1d3b/users/8e0cc8b0a4124d00876212f36ffbf7ba/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:46.925094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d348350b964044d8a220056f10ed1d3b, user_id=8e0cc8b0a4124d00876212f36ffbf7ba, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:46.927758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:46.944442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 791/1610] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:46 2022] PUT /identity/v3/projects/d348350b964044d8a220056f10ed1d3b/users/8e0cc8b0a4124d00876212f36ffbf7ba/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:46.945808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:46.955910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5202-4f25-41b2-86a2-ed1f9c8dc6f9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.009857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:47.017637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cf223-1f61-4dc1-9efa-f7ede97dbd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.018552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cf223-1f61-4dc1-9efa-f7ede97dbd00 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.018779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cf223-1f61-4dc1-9efa-f7ede97dbd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.019129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cf223-1f61-4dc1-9efa-f7ede97dbd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.023739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aad14-8204-45d4-93d9-607e64d09dd5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.029740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cf223-1f61-4dc1-9efa-f7ede97dbd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.031338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cf223-1f61-4dc1-9efa-f7ede97dbd00 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.042024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 820/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:47.043240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadbda-3c60-4042-ab79-cb81aa8ced78 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.043598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadbda-3c60-4042-ab79-cb81aa8ced78 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.043976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadbda-3c60-4042-ab79-cb81aa8ced78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.048836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960da7c-54f5-42b0-93c2-5d3ccc8aecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.049460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960da7c-54f5-42b0-93c2-5d3ccc8aecea admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.049802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960da7c-54f5-42b0-93c2-5d3ccc8aecea admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.050111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960da7c-54f5-42b0-93c2-5d3ccc8aecea admin admin] PATH_INFO: `/v3/projects/216abdc3ecb345818d701cef3fa94b52/users/71c3bed049d948edabfa6ca253a81ca6/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.068959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960da7c-54f5-42b0-93c2-5d3ccc8aecea admin admin] RBAC: Authorizing `identity:create_grant(project_id=216abdc3ecb345818d701cef3fa94b52, user_id=71c3bed049d948edabfa6ca253a81ca6, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.072731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960da7c-54f5-42b0-93c2-5d3ccc8aecea admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.082845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-28fadbda-3c60-4042-ab79-cb81aa8ced78 None None] MFA Rules not processed for user `5e181ccfa7114f829b8a45397f39c99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:47.084858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-28fadbda-3c60-4042-ab79-cb81aa8ced78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.088830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 792/1612] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:46 2022] PUT /identity/v3/projects/216abdc3ecb345818d701cef3fa94b52/users/71c3bed049d948edabfa6ca253a81ca6/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:47.091099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a88026-bce3-4d54-a558-9f10dd356e60 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.091537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a88026-bce3-4d54-a558-9f10dd356e60 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.092656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a88026-bce3-4d54-a558-9f10dd356e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.120107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d7a88026-bce3-4d54-a558-9f10dd356e60 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:47.121655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7a88026-bce3-4d54-a558-9f10dd356e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.175761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:47.208113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 821/1613] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:47.210364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d655-6f37-4b1c-8679-bc417a7c05ac None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.210364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d655-6f37-4b1c-8679-bc417a7c05ac None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.210712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d655-6f37-4b1c-8679-bc417a7c05ac None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.222116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 822/1614] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 18:37:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:37:47.223092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d655-6f37-4b1c-8679-bc417a7c05ac None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:47.234910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 793/1615] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:47.237091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269957-e068-46ad-b2f5-471511297400 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.237595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269957-e068-46ad-b2f5-471511297400 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.238113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269957-e068-46ad-b2f5-471511297400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.271376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-38269957-e068-46ad-b2f5-471511297400 None None] MFA Rules not processed for user `8e0cc8b0a4124d00876212f36ffbf7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:47.272841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-38269957-e068-46ad-b2f5-471511297400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.300794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d655-6f37-4b1c-8679-bc417a7c05ac None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.306349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5018c-efd4-4053-b584-7e0562b9cd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.307507 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5018c-efd4-4053-b584-7e0562b9cd30 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.308035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5018c-efd4-4053-b584-7e0562b9cd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.308549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5018c-efd4-4053-b584-7e0562b9cd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.320752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5018c-efd4-4053-b584-7e0562b9cd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.323229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5018c-efd4-4053-b584-7e0562b9cd30 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.340779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 823/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:47.342210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.342503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.342832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.375330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 794/1617] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:47.375953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269957-e068-46ad-b2f5-471511297400 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:47.376088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] MFA Rules not processed for user `71c3bed049d948edabfa6ca253a81ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:47.377259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.474012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:47.481903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 824/1618] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:47.483369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:47.488884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.491902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269957-e068-46ad-b2f5-471511297400 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.497500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a2ea2-b607-457a-b4d3-7a85e1908967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.498807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2ea2-b607-457a-b4d3-7a85e1908967 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.499095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2ea2-b607-457a-b4d3-7a85e1908967 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.499958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2ea2-b607-457a-b4d3-7a85e1908967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.507179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964ef3c-8e38-4a49-9d45-7dcad8009697 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.512142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a2ea2-b607-457a-b4d3-7a85e1908967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.512713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.513406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.514302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.514752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.514884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a2ea2-b607-457a-b4d3-7a85e1908967 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.527670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 795/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:47.528464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.530249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.541819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 825/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:47.542817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:47.543196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.543492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.543772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.554810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb197-223c-4b1f-8b79-27768f339101 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.563679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010b5a-7d02-44af-8290-aa719a036db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.564556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010b5a-7d02-44af-8290-aa719a036db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.565546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010b5a-7d02-44af-8290-aa719a036db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.566480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010b5a-7d02-44af-8290-aa719a036db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.567518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010b5a-7d02-44af-8290-aa719a036db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.570982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010b5a-7d02-44af-8290-aa719a036db9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.591509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:47.596868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.617184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 796/1621] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:47.617906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:47.630640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9aafd-86f6-46f1-b74b-6b35b7b41482 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:47.634190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 826/1622] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:47.636229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce0d9-f0b3-4121-869c-95fedce2db70 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.636519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce0d9-f0b3-4121-869c-95fedce2db70 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.636933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce0d9-f0b3-4121-869c-95fedce2db70 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.638438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 827/1623] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 18:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:37:47.640082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da575ea7-d0c2-4844-9736-e568adafd6ae None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.640369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da575ea7-d0c2-4844-9736-e568adafd6ae None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.640688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da575ea7-d0c2-4844-9736-e568adafd6ae None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.642385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 828/1624] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 18:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:37:47.643111 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da575ea7-d0c2-4844-9736-e568adafd6ae None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:47.713373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab1be6-1035-44b7-b7e0-1e590b74d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:47.714997 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab1be6-1035-44b7-b7e0-1e590b74d3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.715429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab1be6-1035-44b7-b7e0-1e590b74d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.715645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab1be6-1035-44b7-b7e0-1e590b74d3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.717433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab1be6-1035-44b7-b7e0-1e590b74d3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:47.720148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab1be6-1035-44b7-b7e0-1e590b74d3f5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:47.783263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 797/1625] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:47.785060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9af2-87e5-4175-ad59-26fc7bb75b05 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.785805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9af2-87e5-4175-ad59-26fc7bb75b05 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.786564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9af2-87e5-4175-ad59-26fc7bb75b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.816095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-20dd9af2-87e5-4175-ad59-26fc7bb75b05 None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:47.817410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-20dd9af2-87e5-4175-ad59-26fc7bb75b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:47.962002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 798/1626] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:47.963810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:47.966414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:47.968390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:47.990790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:48.025649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:48.027770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:48.035161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da575ea7-d0c2-4844-9736-e568adafd6ae None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.058029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 799/1627] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:48.058029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.178477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.179358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.179497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.181371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.182097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.188236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.213376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:48.225937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47616c5-d46a-487e-9047-5c4aa8a90c98 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.234772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.235608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.236077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.236511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.236848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 829/1628] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:47 2022] POST /identity/v3/users => generated 290 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:48.237403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.237890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.239535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.271739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 800/1629] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:48 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:48.277225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.451957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59efc-de8e-4c25-9067-4d28842d42a6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.451957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.451957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.455009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4b77-506c-49a4-bb38-62fdc2709da1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.455209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.455209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.455472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.455472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.455472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.455472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.455791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.455791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.455970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.455970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.456117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 801/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:48.456117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.458987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b2e0c-6348-4e4a-bac1-652373ef2278 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.464768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.465486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.466372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.466372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.469839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.472700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.494282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 802/1631] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:48.495209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.502447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 830/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:48.507249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.523939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e544b9-c712-478a-84f3-fc3ac8d183ca admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.530288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.531120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.531789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.532112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.532963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.534830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.535143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b6cbe-180c-4191-beb9-00c34fb088e1 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.541488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.542532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.542926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.543557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] PATH_INFO: `/v3/projects/2e598a2346fe473fbc0c14abc665e801/users/65a0130381ae47f1a332a36b52b9915b/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.547540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 803/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:48.551460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.566591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e598a2346fe473fbc0c14abc665e801, user_id=65a0130381ae47f1a332a36b52b9915b, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.568155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04687f2a-e174-445e-adc4-56fd3e6cdf74 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.570155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.576899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.578376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.579036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.579330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] PATH_INFO: `/v3/projects/142367325cd54d58813b063e9d0be6ac/users/5ce226c25e314d2cab761cb2f9278b5a/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.604686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 831/1634] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:48 2022] PUT /identity/v3/projects/2e598a2346fe473fbc0c14abc665e801/users/65a0130381ae47f1a332a36b52b9915b/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:48.608903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.637415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=142367325cd54d58813b063e9d0be6ac, user_id=5ce226c25e314d2cab761cb2f9278b5a, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.643298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.683647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 804/1635] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:48 2022] PUT /identity/v3/projects/142367325cd54d58813b063e9d0be6ac/users/5ce226c25e314d2cab761cb2f9278b5a/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:48.684846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.731648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28b17b-da81-4014-9d3d-bcc7eac7f337 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.751437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:48.885952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.886930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.887266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.887558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.888432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.891820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.901952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94def0-a4b5-47d2-b2ec-10371d1b79ee admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.914941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 832/1636] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:37:48.915799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.918654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.919352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.919653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.923028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.924826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.927174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.931124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603b2a-0574-4b65-b035-d22d6a1ec3d0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.938265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.939229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:48.939438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:48.939728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] PATH_INFO: `/v3/users/562ad996aece4a77a551a9a673cce958` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:48.941011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562ad996aece4a77a551a9a673cce958)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:48.943656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:48.957343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 805/1637] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:48.957547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:48.982765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebbe2f-d5d2-44a2-aa94-d3da9e8a3d10 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:48.997664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:48.999403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.000870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.001168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] PATH_INFO: `/v3/projects/2e598a2346fe473fbc0c14abc665e801/users/65a0130381ae47f1a332a36b52b9915b/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.003938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e598a2346fe473fbc0c14abc665e801, user_id=65a0130381ae47f1a332a36b52b9915b, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:49.021691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:49.025263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562ad996aece4a77a551a9a673cce958'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:49.045023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562ad996aece4a77a551a9a673cce958'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:49.070306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 806/1638] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:48 2022] PUT /identity/v3/projects/2e598a2346fe473fbc0c14abc665e801/users/65a0130381ae47f1a332a36b52b9915b/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:49.071572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:49.082382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562ad996aece4a77a551a9a673cce958'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:49.085192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562ad996aece4a77a551a9a673cce958'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:49.120567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ebcc711-6ab7-4f4d-be80-2a74db524fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562ad996aece4a77a551a9a673cce958'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:49.147539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 833/1639] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:37:48 2022] DELETE /identity/v3/users/562ad996aece4a77a551a9a673cce958 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:49.152843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378e0a-586d-48a6-a552-57c069198920 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.153175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378e0a-586d-48a6-a552-57c069198920 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.153431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378e0a-586d-48a6-a552-57c069198920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.156690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:49.236223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3f378e0a-586d-48a6-a552-57c069198920 None None] MFA Rules not processed for user `65a0130381ae47f1a332a36b52b9915b`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:49.237873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d216-acf2-42b0-8331-bdbc28c48d1b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:49.239240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3f378e0a-586d-48a6-a552-57c069198920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:49.396409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:49.397321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.399461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.399759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] PATH_INFO: `/v3/projects/142367325cd54d58813b063e9d0be6ac/users/5ce226c25e314d2cab761cb2f9278b5a/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.407657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142367325cd54d58813b063e9d0be6ac, user_id=5ce226c25e314d2cab761cb2f9278b5a, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:49.410688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:49.429337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 834/1640] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:49.429337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c29f2-44bd-4e4a-86f7-b339171d401a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.429337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c29f2-44bd-4e4a-86f7-b339171d401a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.429337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c29f2-44bd-4e4a-86f7-b339171d401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.455872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 807/1641] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:49 2022] PUT /identity/v3/projects/142367325cd54d58813b063e9d0be6ac/users/5ce226c25e314d2cab761cb2f9278b5a/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:49.455872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:49.458732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:49.459778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:49.485441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-344c29f2-44bd-4e4a-86f7-b339171d401a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:49.487026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-344c29f2-44bd-4e4a-86f7-b339171d401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:49.597135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde7a52-d08b-46e3-9c31-7fedda480867 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:49.601110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:49.601784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.602070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.602347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.659239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 835/1642] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:49.660729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.661023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.661303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.739143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] MFA Rules not processed for user `5ce226c25e314d2cab761cb2f9278b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:49.742104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:49.775876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:49.777478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:49.800312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 808/1643] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:49.804646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:49.806510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:49.845010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:49.938370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcae5a-2fa0-4453-91e2-529ebaa0767e service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:49.944169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:49.945445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:49.945738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:49.946014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:49.966118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:49.968266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:49.994533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 809/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:37:49.994868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:50.005906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 836/1645] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:50.015728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:50.017003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:50.021305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990b818-86cb-4951-83ea-a8d2c1e34d04 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:50.025681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:50.025954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:50.026250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:50.026528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:50.029680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:50.037449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772485-d0eb-4129-8a5a-f183a69cf5da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:50.049951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:50.050617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:50.050907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:50.052861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:50.082454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:50.084507 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:50.134231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 837/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:50.191035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:50.193366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:50.234986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 810/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:52.391003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:52.393164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:52.446868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9aa9-e1f5-441c-af66-720d46b54baf service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:52.466468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:52.468533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:52.468991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:52.469637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] PATH_INFO: `/v3/projects/f3edb8dc4f1946dc985dd1c0fb510c07` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:52.471081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3edb8dc4f1946dc985dd1c0fb510c07)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:52.474193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: WARNING py.warnings [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:37:52.474193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: warnings.warn(msg) Jun 22 18:37:52.474193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: Jun 22 18:37:52.476206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:52.620559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3edb8dc4f1946dc985dd1c0fb510c07', 'request_id': 'req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:52.658366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3edb8dc4f1946dc985dd1c0fb510c07', 'request_id': 'req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:52.676573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3edb8dc4f1946dc985dd1c0fb510c07', 'request_id': 'req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:52.692456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:52.699723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:52.702822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:52.705903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] The token cache is being invalidate because project f3edb8dc4f1946dc985dd1c0fb510c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:37:52.706467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:52.712371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ab2a811c-70fc-4a6b-b8fc-6479199d46f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:52.715134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 838/1648] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:37:52 2022] DELETE /identity/v3/projects/f3edb8dc4f1946dc985dd1c0fb510c07 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:52.721059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfc625-ee0f-4656-bdb1-9e0879d2d823 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:52.721767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfc625-ee0f-4656-bdb1-9e0879d2d823 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:52.722283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfc625-ee0f-4656-bdb1-9e0879d2d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:52.739552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0de8-d677-485a-b63e-5475d56eef7f service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:52.765849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3fcfc625-ee0f-4656-bdb1-9e0879d2d823 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:52.767199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3fcfc625-ee0f-4656-bdb1-9e0879d2d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:52.945618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 839/1649] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:52.954514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:52.954814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:52.955090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:52.974670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:52.975675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:52.976020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:52.976328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] PATH_INFO: `/v3/users/5e181ccfa7114f829b8a45397f39c99a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:52.979288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e181ccfa7114f829b8a45397f39c99a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:52.982420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: WARNING py.warnings [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:37:52.982420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: warnings.warn(msg) Jun 22 18:37:52.982420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: Jun 22 18:37:52.993493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:52.993659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:52.994789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:53.022079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 840/1650] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:37:53.026275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.043404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d68666-d3d3-47b9-b189-1b125eba0fc4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:53.062433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:53.063132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:53.063441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:53.063708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:53.064491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:53.064809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:53.068196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:53.111888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 841/1651] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:53.121590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.148048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2642cab-a366-465b-8997-1930acc10cce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:53.161659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:53.162344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:53.162636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:53.162920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:53.163610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:53.165651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:53.229083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 842/1652] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:53 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:53.233879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.276943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e181ccfa7114f829b8a45397f39c99a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:53.327864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:53.348396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e181ccfa7114f829b8a45397f39c99a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:53.369988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e181ccfa7114f829b8a45397f39c99a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:53.370631 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e181ccfa7114f829b8a45397f39c99a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:53.371352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b006a935-b1e6-4ce8-b07f-ab9aeb613f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e181ccfa7114f829b8a45397f39c99a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:53.432654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 811/1653] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:37:52 2022] DELETE /identity/v3/users/5e181ccfa7114f829b8a45397f39c99a => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:53.437751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:53.438094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:53.438386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:53.461490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0e9a-a37f-48d3-9023-83a9bb9dbbd2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:53.520243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:53.521789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:53.693543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:53.694239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:53.694530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:53.694813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:53.695525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:53.697558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:53.733657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:53.754705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 812/1654] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:53.774010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 843/1655] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:53 2022] POST /identity/v3/users => generated 283 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:53.777588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.779657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:53.807614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fe5d0-79a3-4d39-8fa9-ea8e0994ebe7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:53.830684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:53.831378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:53.831668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:53.831987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:53.832762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:53.834433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:53.875663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 813/1656] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:53.879793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.899468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.905869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ec9e-887e-4d08-88cc-aa87491c3edf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:53.911528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:53.919534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:53.925715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:53.930346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:53.931858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:53.932899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:53.969476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:53.985708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 844/1657] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:53.989479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:53.990713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6bb76-2d51-478e-b3f0-6f1632a48372 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:54.003734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:54.004669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.005109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.005552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] PATH_INFO: `/v3/users/71c3bed049d948edabfa6ca253a81ca6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.009127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c3bed049d948edabfa6ca253a81ca6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:54.011286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:54.023575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063541b-94ee-4be5-b8ce-f9c0b59ff0d0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:54.042949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdc19c-0f15-47d4-832f-58c9058da4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:54.056477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdc19c-0f15-47d4-832f-58c9058da4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.060311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdc19c-0f15-47d4-832f-58c9058da4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.062093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdc19c-0f15-47d4-832f-58c9058da4e5 admin admin] PATH_INFO: `/v3/projects/0791d108b67e400ba1c081573748db12/users/83a7b90f1138403fb7fb8f6074269719/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.110185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdc19c-0f15-47d4-832f-58c9058da4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0791d108b67e400ba1c081573748db12, user_id=83a7b90f1138403fb7fb8f6074269719, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:54.122622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdc19c-0f15-47d4-832f-58c9058da4e5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:54.168576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 845/1658] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:53 2022] PUT /identity/v3/projects/0791d108b67e400ba1c081573748db12/users/83a7b90f1138403fb7fb8f6074269719/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:54.181256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752ae74-151c-4e26-8f9b-9e2b1c38e4b7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.181854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752ae74-151c-4e26-8f9b-9e2b1c38e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.182385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752ae74-151c-4e26-8f9b-9e2b1c38e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.221028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c3bed049d948edabfa6ca253a81ca6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:54.239179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0752ae74-151c-4e26-8f9b-9e2b1c38e4b7 None None] MFA Rules not processed for user `83a7b90f1138403fb7fb8f6074269719`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:54.240696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0752ae74-151c-4e26-8f9b-9e2b1c38e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:54.271378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c3bed049d948edabfa6ca253a81ca6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:54.297428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c3bed049d948edabfa6ca253a81ca6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:54.298165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c3bed049d948edabfa6ca253a81ca6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:54.299104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c3bed049d948edabfa6ca253a81ca6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:54.344742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 814/1659] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:37:53 2022] DELETE /identity/v3/users/71c3bed049d948edabfa6ca253a81ca6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:54.345451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:54.349178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:54.420317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 846/1660] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:54.423313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.426923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.427315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.485462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:54.497613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:54.517072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:54.557310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6edd1-b16e-41a4-b395-29c896089f1d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:54.570210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:54.571054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.571462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.571897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.577072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:54.639480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 847/1661] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:54.640596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:54.642057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:54.661848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c087ec-baa1-40cb-9b4b-a3c8089391a2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:54.669109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:54.672290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.672867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.673303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.674263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:54.678589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:54.696178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:54.697799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:54.737328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 848/1662] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:54 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:54.737660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 815/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:54.739127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:54.740202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:54.742035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:54.763146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec5a02-df4f-41d8-8e9d-8bf57aed9c23 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:54.803664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:54.895977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:54.897150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.897696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.898173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.898449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc65cd-fc5e-45ef-b310-312cdf9f86c0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:54.899338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:54.903700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:54.908540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:54.909220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:54.922435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:54.922803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:54.946288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:54.949468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:54.958578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 816/1664] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:54 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:54.964621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:54.985601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 849/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:54.999115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b5675-71db-4267-a780-5b484711d353 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:55.010730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:55.011339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:55.011663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:55.012071 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:55.012942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:55.016186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:55.041662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 817/1666] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:37:55.042863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:55.076901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3cd38-dd65-413b-9c85-5973553f44d8 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:55.092919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:55.094018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:55.095500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:55.096463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] PATH_INFO: `/v3/projects/482a86d536904d28bf5e134e1d2b2c84/users/91a6b3c68d3640f99ec0991dd51b08ac/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:55.147463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=482a86d536904d28bf5e134e1d2b2c84, user_id=91a6b3c68d3640f99ec0991dd51b08ac, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:55.153237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:55.196856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 850/1667] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:55 2022] PUT /identity/v3/projects/482a86d536904d28bf5e134e1d2b2c84/users/91a6b3c68d3640f99ec0991dd51b08ac/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:55.201938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:55.219892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f326b-be73-4390-b978-4b956c04defe admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:55.402189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590d73-1a4b-4713-8631-be8d9e6dc453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:55.403169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590d73-1a4b-4713-8631-be8d9e6dc453 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:55.403649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590d73-1a4b-4713-8631-be8d9e6dc453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:55.404037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590d73-1a4b-4713-8631-be8d9e6dc453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:55.405105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f590d73-1a4b-4713-8631-be8d9e6dc453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:55.407007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f590d73-1a4b-4713-8631-be8d9e6dc453 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:55.436555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 818/1668] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:55.440831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:55.460585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383d1a-fe95-4295-8437-be73d9c2e83d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:55.493678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:55.495131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:55.495500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:55.496111 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] PATH_INFO: `/v3/projects/482a86d536904d28bf5e134e1d2b2c84/users/91a6b3c68d3640f99ec0991dd51b08ac/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:55.500961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482a86d536904d28bf5e134e1d2b2c84, user_id=91a6b3c68d3640f99ec0991dd51b08ac, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:55.505161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:55.584714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 851/1669] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:55 2022] PUT /identity/v3/projects/482a86d536904d28bf5e134e1d2b2c84/users/91a6b3c68d3640f99ec0991dd51b08ac/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:55.591859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:55.592452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:55.597619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:55.640061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:55.741649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] MFA Rules not processed for user `91a6b3c68d3640f99ec0991dd51b08ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:55.743086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:56.001854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 819/1670] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:56.017012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:56.018783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:56.246774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4016a4-94d0-4fc7-a3ae-1ff5f2fb4310 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:56.275411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:56.276136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:56.276453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:56.276740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:56.287768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:56.289302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:56.301455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 852/1671] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:37:56.457116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:56.469413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b288be9-3d97-4b9a-aaa7-04f603544620 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:56.476049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:56.477390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:56.490134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:56.490913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:56.492462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:56.492905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:56.621938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d07457-8bfb-48a3-b632-a8611dbc7824 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:56.635469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:56.637791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:56.649474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:56.650903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:56.651194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:56.651473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] PATH_INFO: `/v3/users/8e0cc8b0a4124d00876212f36ffbf7ba` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:56.657920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0cc8b0a4124d00876212f36ffbf7ba)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:56.662599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:56.670149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 820/1672] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:37:56.731442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:56.733028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:56.778474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e87d-86ea-4193-be6d-5da2fbc237ce service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:56.803942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:56.806186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:56.807205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:56.810519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:56.812037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] PATH_INFO: `/v3/projects/216abdc3ecb345818d701cef3fa94b52` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:56.818134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216abdc3ecb345818d701cef3fa94b52)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:56.822491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:56.845281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0cc8b0a4124d00876212f36ffbf7ba'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:56.890029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0cc8b0a4124d00876212f36ffbf7ba'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:56.908762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0cc8b0a4124d00876212f36ffbf7ba'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:56.910079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0cc8b0a4124d00876212f36ffbf7ba'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:56.929721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f4b93fac-e1be-4503-8175-6ee20bd507a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0cc8b0a4124d00876212f36ffbf7ba'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:56.949891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 853/1673] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:37:56 2022] DELETE /identity/v3/users/8e0cc8b0a4124d00876212f36ffbf7ba => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:37:56.955714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:56.958670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:56.960059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:56.999148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216abdc3ecb345818d701cef3fa94b52', 'request_id': 'req-6872e506-fc4a-4766-8a4a-5edddacfb8d1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.023361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216abdc3ecb345818d701cef3fa94b52', 'request_id': 'req-6872e506-fc4a-4766-8a4a-5edddacfb8d1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.043760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:57.048224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216abdc3ecb345818d701cef3fa94b52', 'request_id': 'req-6872e506-fc4a-4766-8a4a-5edddacfb8d1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.050255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:57.096633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] The token cache is being invalidate because project 216abdc3ecb345818d701cef3fa94b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:37:57.096978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.101005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.114750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 821/1674] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:37:56 2022] DELETE /identity/v3/projects/216abdc3ecb345818d701cef3fa94b52 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:37:57.116211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:57.119432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:57.161577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:57.210308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 854/1675] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:57.300024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:57.301800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:57.395217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e506-fc4a-4766-8a4a-5edddacfb8d1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:57.416460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:57.418433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:57.418846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:57.419133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] PATH_INFO: `/v3/users/5ce226c25e314d2cab761cb2f9278b5a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:57.424585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce226c25e314d2cab761cb2f9278b5a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:57.433486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:57.445314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374cd97-982d-4c1e-9f93-d887df968ff8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:57.463221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:57.468652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:57.471555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:57.473291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:57.534500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:57.546488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:57.574683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce226c25e314d2cab761cb2f9278b5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.588308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 855/1676] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:37:57.603603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce226c25e314d2cab761cb2f9278b5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.628683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce226c25e314d2cab761cb2f9278b5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.629440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce226c25e314d2cab761cb2f9278b5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.630252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b387de77-6286-4591-91d1-84a46482e7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce226c25e314d2cab761cb2f9278b5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.660018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 822/1677] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:37:57 2022] DELETE /identity/v3/users/5ce226c25e314d2cab761cb2f9278b5a => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:57.691723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:57.694967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:57.712862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089f1a-ef66-4086-99fa-6e5bf0d39de0 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:57.870697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:57.891357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:57.892572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:57.892853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:57.897889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] PATH_INFO: `/v3/projects/966e6f6793f54469984c1edc47fb9437` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:57.899821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966e6f6793f54469984c1edc47fb9437)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:57.906368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:57.979430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966e6f6793f54469984c1edc47fb9437', 'request_id': 'req-cb95db24-b6a9-4185-8a36-39f5a11c8282'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.989872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966e6f6793f54469984c1edc47fb9437', 'request_id': 'req-cb95db24-b6a9-4185-8a36-39f5a11c8282'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:57.997954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966e6f6793f54469984c1edc47fb9437', 'request_id': 'req-cb95db24-b6a9-4185-8a36-39f5a11c8282'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:58.018720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] The token cache is being invalidate because project 966e6f6793f54469984c1edc47fb9437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:37:58.019299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:58.020086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb95db24-b6a9-4185-8a36-39f5a11c8282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:58.025737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 856/1678] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:37:57 2022] DELETE /identity/v3/projects/966e6f6793f54469984c1edc47fb9437 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:58.027745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.028231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.028610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.056763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:58.058803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:58.180766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.181021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.181258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.192606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 823/1679] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:58.206068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:58.208748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:58.226990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:58.238234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 857/1680] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:58.238468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b4309-45b0-40a7-a7ef-26230756fec5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:58.244739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:58.245415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.245698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.246326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.247252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:37:58.248330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:58.251069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:58.290448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 824/1681] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:37:58.296786 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:58.314035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70150a05-a5e0-4626-bcea-d7b99d82567d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:58.327295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:58.331679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.332102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.332435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.333176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:58.341051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:58.435763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 858/1682] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:58 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:58.440382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:58.457958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba1623-5cd4-4810-a251-7fe48646daff admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:58.490927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:58.624869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:58.627290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.627697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.628093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.629033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:58.634790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:58.687097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 825/1683] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:58 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:37:58.689927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:58.710649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91bc6a-6bc0-4d62-94e2-d1daf31fb3ea admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:58.717712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:58.718416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.718705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.718987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.719739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:58.721440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:58.756068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 859/1684] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:58.760659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:58.787357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234927b9-7fe8-40ff-8651-5b792fe8b81b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:58.836763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda2370-eefb-4494-93a5-f9c5dfcaafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:58.839565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2370-eefb-4494-93a5-f9c5dfcaafb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.840264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2370-eefb-4494-93a5-f9c5dfcaafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.840774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2370-eefb-4494-93a5-f9c5dfcaafb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.846414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda2370-eefb-4494-93a5-f9c5dfcaafb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:58.857214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda2370-eefb-4494-93a5-f9c5dfcaafb3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:58.905263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 826/1685] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:37:58.906769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:58.920002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6b3a-9825-4dd3-86a6-a29e05cc0a91 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:58.942032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:58.942926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:58.943251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:58.943685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] PATH_INFO: `/v3/projects/e285f6f2771a46e681b278a25d4f6fdb/users/3db9f454080b4ab39eca8a8ac36e1efb/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:58.968982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e285f6f2771a46e681b278a25d4f6fdb, user_id=3db9f454080b4ab39eca8a8ac36e1efb, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:58.971751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:59.011700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 860/1686] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:37:58 2022] PUT /identity/v3/projects/e285f6f2771a46e681b278a25d4f6fdb/users/3db9f454080b4ab39eca8a8ac36e1efb/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:59.027752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:59.028255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:59.029422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:59.121892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] MFA Rules not processed for user `3db9f454080b4ab39eca8a8ac36e1efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:37:59.128194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:59.346897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:59.349044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:59.405597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 827/1687] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:37:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:37:59.406159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:59.545908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9c99-2097-4701-a7ee-f1a6e5052fa8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:59.561500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:59.562712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:59.563418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:59.563859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] PATH_INFO: `/v3/projects/d348350b964044d8a220056f10ed1d3b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:59.566376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d31ed-9f76-4936-8cf0-808e47bf5a4b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:59.569175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d348350b964044d8a220056f10ed1d3b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:59.572342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:59.596723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:59.597406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:59.599488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:59.599773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:59.601454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:37:59.607916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:37:59.671326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:59.679923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 828/1688] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:37:59 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:37:59.682417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:59.687652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:59.714002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd348350b964044d8a220056f10ed1d3b', 'request_id': 'req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:59.714734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:59.722111 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd348350b964044d8a220056f10ed1d3b', 'request_id': 'req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:59.734732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd348350b964044d8a220056f10ed1d3b', 'request_id': 'req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:59.774362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] The token cache is being invalidate because project d348350b964044d8a220056f10ed1d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:37:59.774678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:59.775510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:37:59.777023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 861/1689] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:37:59 2022] DELETE /identity/v3/projects/d348350b964044d8a220056f10ed1d3b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:37:59.778011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:37:59.788764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:37:59.896058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9471-d2a6-4412-adc9-1daed5a36d3b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:59.981509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb80ff-45ce-4eb7-9ac0-6838c67bd47d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:37:59.995419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:37:59.996380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:37:59.996836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:37:59.997262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:37:59.998236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.000425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.044281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 862/1690] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:37:59 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:00.045651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.055261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:00.057002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:00.057821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.058058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.058347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] PATH_INFO: `/v3/projects/142367325cd54d58813b063e9d0be6ac` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.065432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142367325cd54d58813b063e9d0be6ac)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.067465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.083891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f72c-5a6f-47ce-bd3a-aef25a19aa6e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:00.090374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:00.092265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.092822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.093251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] PATH_INFO: `/v3/users/65a0130381ae47f1a332a36b52b9915b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.114688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a0130381ae47f1a332a36b52b9915b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.117068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.186621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142367325cd54d58813b063e9d0be6ac', 'request_id': 'req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.202712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142367325cd54d58813b063e9d0be6ac', 'request_id': 'req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.235699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142367325cd54d58813b063e9d0be6ac', 'request_id': 'req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.255297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a0130381ae47f1a332a36b52b9915b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.275161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] The token cache is being invalidate because project 142367325cd54d58813b063e9d0be6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:00.275784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.278326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.281757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 829/1691] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:37:59 2022] DELETE /identity/v3/projects/142367325cd54d58813b063e9d0be6ac => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:00.284634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.296308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a0130381ae47f1a332a36b52b9915b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.302201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:00.312963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a0130381ae47f1a332a36b52b9915b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.313707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a0130381ae47f1a332a36b52b9915b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.330454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-672fde3d-46ed-4fa2-87ac-929909633fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a0130381ae47f1a332a36b52b9915b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:00.344287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 863/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:00 2022] DELETE /identity/v3/users/65a0130381ae47f1a332a36b52b9915b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:00.346144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80380-4fd5-481d-a91b-f3d7b8abd134 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.346608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80380-4fd5-481d-a91b-f3d7b8abd134 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.347050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80380-4fd5-481d-a91b-f3d7b8abd134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.382205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1ff80380-4fd5-481d-a91b-f3d7b8abd134 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:00.386497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1ff80380-4fd5-481d-a91b-f3d7b8abd134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:00.403232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=16,keystone:SELECT=79,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:00.475278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:00.519518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61241e-93a9-4ecc-97f2-0d9fc24ba503 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:00.582869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 864/1693] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:00.585271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.585271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.585271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.643731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:00.645339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:00.668363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 865/1694] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:00.670110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.693289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdfd3-f13b-48b1-a563-0c1a633dd12e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:00.698590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:00.699546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.701153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.701722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.702711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:00.703248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.705352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.722513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 866/1695] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:38:00.724232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.735371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f211b5e-077f-4d5a-9a09-c024db9c74ae admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:00.742952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:00.744006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.744522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.745330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.758427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.760987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.769020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:00.769722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.770013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.770292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.773948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.775294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.805948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 867/1696] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:00 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:00.807300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 830/1697] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:00.808352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.810981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.814750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:00.850136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ca5b2-028d-4185-83be-e98fc269c9d1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:00.898336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce819-db41-4221-9e34-21f732739dfc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:00.904777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:00.905773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:00.906247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:00.906641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:00.907485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:00.909681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:00.960344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 868/1698] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:00 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:00.963304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:00.968544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.001491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.002710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.003111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.003501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] PATH_INFO: `/v3/users/83a7b90f1138403fb7fb8f6074269719` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.005192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a7b90f1138403fb7fb8f6074269719)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.006500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db2786-a05f-497d-b761-0f34bc16e599 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.007681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.029372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.031001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.031289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.031577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] PATH_INFO: `/v3/projects/043e6a14306543fbbca3d215ea05849a/users/036e27a7424642448dc92ce8ed45c2ea/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.068751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=043e6a14306543fbbca3d215ea05849a, user_id=036e27a7424642448dc92ce8ed45c2ea, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.071549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.108740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 869/1699] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:00 2022] PUT /identity/v3/projects/043e6a14306543fbbca3d215ea05849a/users/036e27a7424642448dc92ce8ed45c2ea/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:01.109823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.112136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a7b90f1138403fb7fb8f6074269719'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:01.130004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a7b90f1138403fb7fb8f6074269719'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:01.148399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a7b90f1138403fb7fb8f6074269719'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:01.149986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a7b90f1138403fb7fb8f6074269719'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:01.151111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a7b90f1138403fb7fb8f6074269719'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:01.200444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 831/1700] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:00 2022] DELETE /identity/v3/users/83a7b90f1138403fb7fb8f6074269719 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:01.201758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.205591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.226272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:01.236254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:01.285646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe86f-2207-42e7-90f0-ea0ae3386cdb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.347059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f307-0b34-479c-85c6-207518fa8e82 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.354995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa073c-4066-4f10-b3d0-da81771afa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.356641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa073c-4066-4f10-b3d0-da81771afa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.364219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa073c-4066-4f10-b3d0-da81771afa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.364934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa073c-4066-4f10-b3d0-da81771afa7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.366681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa073c-4066-4f10-b3d0-da81771afa7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.370824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa073c-4066-4f10-b3d0-da81771afa7c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.394523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 832/1701] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:01.396587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.397028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.397504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.438679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:01.440196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.454983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 833/1702] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:01.455952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.482197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55846f-66ef-4b67-a3b6-2e0e5bea8da6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.492737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.493452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.493797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.494102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.495384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.497611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.497770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.498214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.498663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.498947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] PATH_INFO: `/v3/projects/043e6a14306543fbbca3d215ea05849a/users/036e27a7424642448dc92ce8ed45c2ea/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.506121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] RBAC: Authorizing `identity:create_grant(project_id=043e6a14306543fbbca3d215ea05849a, user_id=036e27a7424642448dc92ce8ed45c2ea, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.509491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.538208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 834/1703] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:01 2022] PUT /identity/v3/projects/043e6a14306543fbbca3d215ea05849a/users/036e27a7424642448dc92ce8ed45c2ea/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:01.539200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.543105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 870/1704] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:01.548734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.554335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.562506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.597477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5947-1f85-4173-9a36-8a9d254d75de admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.673301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669521c6-8393-401f-ab3c-e717cec1797b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.720633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.723710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.724687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.725641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.735563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83d172-3748-46b6-b77f-ac87f645afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.737914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d172-3748-46b6-b77f-ac87f645afbd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.738204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d172-3748-46b6-b77f-ac87f645afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.738487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d172-3748-46b6-b77f-ac87f645afbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.739258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83d172-3748-46b6-b77f-ac87f645afbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.748248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83d172-3748-46b6-b77f-ac87f645afbd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.765593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 871/1705] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:38:01.767359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.768008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.768470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.777180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.778427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.814441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 835/1706] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:01.815548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.816571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] MFA Rules not processed for user `036e27a7424642448dc92ce8ed45c2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:01.817986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.835947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f253d3-82fa-4597-bf28-2b8bddd9d6a4 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:01.844081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81f23a-49b1-45b9-95e7-991d33ef607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:01.845137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81f23a-49b1-45b9-95e7-991d33ef607c admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.845488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81f23a-49b1-45b9-95e7-991d33ef607c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.846984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81f23a-49b1-45b9-95e7-991d33ef607c admin admin] PATH_INFO: `/v3/projects/4bde6b7ca48445638a8e6e302edb3923/users/9f0015c46e8c4d6aa54a4ad56a94c452/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.874092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81f23a-49b1-45b9-95e7-991d33ef607c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bde6b7ca48445638a8e6e302edb3923, user_id=9f0015c46e8c4d6aa54a4ad56a94c452, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:01.881160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81f23a-49b1-45b9-95e7-991d33ef607c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:01.931675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 872/1707] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:01.948114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 836/1708] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:01 2022] PUT /identity/v3/projects/4bde6b7ca48445638a8e6e302edb3923/users/9f0015c46e8c4d6aa54a4ad56a94c452/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:01.956374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:01.959159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:01.959633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:01.959971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:01.970823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:01.986058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:02.017414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] MFA Rules not processed for user `9f0015c46e8c4d6aa54a4ad56a94c452`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:02.029148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:02.115596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f35b2-828d-4c6f-affa-1f61b4914233 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:02.173345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:02.205413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 837/1709] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:02.209505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:02.233680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:02.234663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:02.235090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:02.235507 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:02.360924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e63f4-ea63-478e-8e26-9d96af42fe69 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:02.367293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8182d1-fb09-4df4-97a5-aa4cb00e6387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:02.368393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8182d1-fb09-4df4-97a5-aa4cb00e6387 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:02.370042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8182d1-fb09-4df4-97a5-aa4cb00e6387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:02.370793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8182d1-fb09-4df4-97a5-aa4cb00e6387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:02.374835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8182d1-fb09-4df4-97a5-aa4cb00e6387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:02.379040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:02.380912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8182d1-fb09-4df4-97a5-aa4cb00e6387 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:02.381758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:02.420989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 873/1710] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:02.450192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 838/1711] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:02 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:02.455992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:02.477565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71bb2-361e-4101-b071-c7f2c582bd16 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:02.516292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:02.516765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:02.517151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:02.583369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] MFA Rules not processed for user `3eae8de1576148ed83eaf66da7971818`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:02.584968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:02.697449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:02.698402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:02.700195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:02.701023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:02.702189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:02.709077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:02.769233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 839/1712] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:02.772416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:02.773483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:02.789797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 874/1713] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:02 2022] POST /identity/v3/users => generated 294 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:02.789797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:02.796325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:02.833396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fd15-1126-4ffb-8e1a-6e9aadcc8e05 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:02.849033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:02.849927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:02.850206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:02.850481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] PATH_INFO: `/v3/projects/2e598a2346fe473fbc0c14abc665e801` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:02.857753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e598a2346fe473fbc0c14abc665e801)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:02.860145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:02.992223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e598a2346fe473fbc0c14abc665e801', 'request_id': 'req-e80bc182-eb42-42ce-8904-510326b5f5fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:02.994210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482da03-fffc-4fa5-af4b-783d9baedd6f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:03.010142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e598a2346fe473fbc0c14abc665e801', 'request_id': 'req-e80bc182-eb42-42ce-8904-510326b5f5fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:03.024382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e598a2346fe473fbc0c14abc665e801', 'request_id': 'req-e80bc182-eb42-42ce-8904-510326b5f5fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:03.046157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:03.064478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] The token cache is being invalidate because project 2e598a2346fe473fbc0c14abc665e801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:03.064792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:03.070754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e80bc182-eb42-42ce-8904-510326b5f5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:03.080134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 875/1714] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:02 2022] DELETE /identity/v3/projects/2e598a2346fe473fbc0c14abc665e801 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:03.082051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:03.088291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:03.088659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:03.141124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:03.142279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:03.142752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] MFA Rules not processed for user `3eae8de1576148ed83eaf66da7971818`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:03.142951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:03.143424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:03.144172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:03.146718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:03.290926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:03.293762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728981a-95fb-4619-83cd-b98b3bb81dae service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:03.311155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 876/1715] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:03.312246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:03.315260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 840/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:03.317114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:03.317465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:03.317846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:03.330119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:03.363765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:03.369513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:03.566335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d1b0e-84d4-4c64-ab1a-66c035ad6f84 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:03.575590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 841/1717] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:03.579682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:03.582555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:03.600897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1f405-5348-4e5a-9bff-2dea3d1037a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:03.601653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f405-5348-4e5a-9bff-2dea3d1037a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:03.601940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f405-5348-4e5a-9bff-2dea3d1037a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:03.602224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f405-5348-4e5a-9bff-2dea3d1037a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:03.605669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1f405-5348-4e5a-9bff-2dea3d1037a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:03.611786 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1f405-5348-4e5a-9bff-2dea3d1037a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:03.655054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 877/1718] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:03.660778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:03.661076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:03.661359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:03.719953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:03.722464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:03.762055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 878/1719] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:03.763331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:03.790953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdb4bf-519e-4483-a5ce-2689489ac313 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:03.807568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:03.809300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:03.811109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:03.811592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] PATH_INFO: `/v3/projects/a90563f378f0450fb07534922cf84020/users/0e793d3c434d437dbf094c06f4efc073/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:03.858317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90563f378f0450fb07534922cf84020, user_id=0e793d3c434d437dbf094c06f4efc073, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:03.869634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:03.882308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:03.903610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 879/1720] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:03 2022] PUT /identity/v3/projects/a90563f378f0450fb07534922cf84020/users/0e793d3c434d437dbf094c06f4efc073/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:03.905631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:03.977152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b846fdb-45a4-471f-a65a-6086b574448f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.006392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:04.083068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0521d1-9c19-44f3-a445-3aa9bfd09f32 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.100280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:04.100984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.101277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.101563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.102921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:04.103878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:04.105801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:04.122144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:04.123724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.124197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.127921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 880/1721] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:04.128834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.130182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:04.134465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:04.142296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b2c8-472c-4eb5-b007-ffd1ba7b72ed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.163674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e77544-4c37-4d74-b54a-18b0dc10885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:04.165568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77544-4c37-4d74-b54a-18b0dc10885f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.166538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77544-4c37-4d74-b54a-18b0dc10885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.166832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77544-4c37-4d74-b54a-18b0dc10885f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.170337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e77544-4c37-4d74-b54a-18b0dc10885f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:04.172921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e77544-4c37-4d74-b54a-18b0dc10885f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:04.191193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 881/1722] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:04.192717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.193013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.193295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.272019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] MFA Rules not processed for user `8978ed54252843f78b0d00d37b475ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:04.277223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:04.302967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:04.307316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:04.334444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 842/1723] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:04.349211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:04.383793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63cf0f-f3b4-4beb-a756-cc51a0f27209 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.390064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23722523-b886-4a3a-96d6-dc28709b51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:04.390738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722523-b886-4a3a-96d6-dc28709b51d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.391020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722523-b886-4a3a-96d6-dc28709b51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.391289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722523-b886-4a3a-96d6-dc28709b51d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.392015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23722523-b886-4a3a-96d6-dc28709b51d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:04.405138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23722523-b886-4a3a-96d6-dc28709b51d2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:04.433237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 882/1724] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:04.437829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:04.467280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2829e7-4cb4-4617-82f6-c47b60e4e7b2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.478068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 843/1725] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:04.480048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:04.483939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.486152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.486244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.486537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.486633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] PATH_INFO: `/v3/projects/a90563f378f0450fb07534922cf84020/users/0e793d3c434d437dbf094c06f4efc073/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.486822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.490212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90563f378f0450fb07534922cf84020, user_id=0e793d3c434d437dbf094c06f4efc073, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:04.494534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:04.510319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 883/1726] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:04 2022] PUT /identity/v3/projects/a90563f378f0450fb07534922cf84020/users/0e793d3c434d437dbf094c06f4efc073/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:04.511286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:04.514520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:04.536211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] MFA Rules not processed for user `d32582f1a1994e3b9c05f56185d0079d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:04.537387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:04.625626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:04.643432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c08fe9-658d-4054-929e-4bd134999193 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.654356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 844/1727] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:04.655442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:04.662295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:04.666994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:04.667923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:04.668268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:04.668549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] PATH_INFO: `/v3/projects/0791d108b67e400ba1c081573748db12` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:04.671258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0791d108b67e400ba1c081573748db12)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:04.680156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:04.718313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:04.818580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0791d108b67e400ba1c081573748db12', 'request_id': 'req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:04.834778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0791d108b67e400ba1c081573748db12', 'request_id': 'req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:04.850318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0791d108b67e400ba1c081573748db12', 'request_id': 'req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:04.870357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaf4f9-806e-487c-8452-86c1ecf7320e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:04.876510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] The token cache is being invalidate because project 0791d108b67e400ba1c081573748db12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:04.876807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:04.878369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:04.880325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 884/1728] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:04 2022] DELETE /identity/v3/projects/0791d108b67e400ba1c081573748db12 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:04.884619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:04.887210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:05.090522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:05.091729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.092046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.092325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.105422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:05.208995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e92ad8-6635-4e9f-926a-2deba7cf68fd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:05.219737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:05.221556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.242012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.242718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.244440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:05.251044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:05.274371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:05.276039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275b82-a4f6-410c-880e-844fe955ae62 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:05.308440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 845/1729] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:05.309368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.309646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.309991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.333519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 885/1730] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:04 2022] POST /identity/v3/users => generated 293 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:05.338840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:05.350678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:05.408148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] MFA Rules not processed for user `0e793d3c434d437dbf094c06f4efc073`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:05.410213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:05.417592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0672d-0cc8-4408-aed3-d1fab6944386 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:05.451083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:05.454136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.456848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.458623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] PATH_INFO: `/v3/users/91a6b3c68d3640f99ec0991dd51b08ac` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.468234 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a6b3c68d3640f99ec0991dd51b08ac)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:05.479718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:05.604262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:05.636523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a6b3c68d3640f99ec0991dd51b08ac'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:05.679201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a6b3c68d3640f99ec0991dd51b08ac'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:05.687535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:05.698419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 846/1731] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:05.699954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:05.710046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a6b3c68d3640f99ec0991dd51b08ac'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:05.710824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a6b3c68d3640f99ec0991dd51b08ac'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:05.736866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1aecec0d-e9d5-4cd9-93e9-30e6c96fe2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a6b3c68d3640f99ec0991dd51b08ac'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:05.739945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a7e60-2b9a-4364-ad4a-10ad9742fbaa None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:05.780986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 886/1732] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:05 2022] DELETE /identity/v3/users/91a6b3c68d3640f99ec0991dd51b08ac => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:05.802861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:05.803548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.803860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.804003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87caf-0013-4382-89a0-fc0b3f084ecf None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.804300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87caf-0013-4382-89a0-fc0b3f084ecf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.804580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87caf-0013-4382-89a0-fc0b3f084ecf None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.807826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.812619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:05.814826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 887/1733] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 18:38:05 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:38:05.816233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:05.821290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:05.822027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:05.823434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:05.847647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 847/1734] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:05.852068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:05.861595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:05.939820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] MFA Rules not processed for user `94d5713dc97f442f916b22d925c35042`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:05.941565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.032372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f5ce-29b6-43cf-850e-9e6bbb9b2fc1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:06.154931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 888/1735] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:06.156771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:06.158650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.191203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:06.191891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.192184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.192463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.198789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.286557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986be4a-160f-4e3a-8a25-ba02b2bd1b1b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:06.295825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:06.296859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.297514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.297947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.314709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.407178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:06.410065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:06.411112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e116e6-0b42-4e39-a529-eecacbd325a3 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:06.412190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:06.438518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 848/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:06.439065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 889/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:06.440063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.440687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.440979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.443054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:06.446377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.496166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:06.556022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:06.558674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.663754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:06.692568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd48c5-3154-4dde-a5ce-2669462d7f72 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:06.727528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c47239-6c55-4a70-a4eb-2a1141a62b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:06.728278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47239-6c55-4a70-a4eb-2a1141a62b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.728645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47239-6c55-4a70-a4eb-2a1141a62b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.728932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47239-6c55-4a70-a4eb-2a1141a62b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.729687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c47239-6c55-4a70-a4eb-2a1141a62b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:06.732436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c47239-6c55-4a70-a4eb-2a1141a62b1e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:06.785977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 890/1738] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:06.785977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.785977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.785977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.831398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 849/1739] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:38:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:06.834541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:06.840563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] MFA Rules not processed for user `94d5713dc97f442f916b22d925c35042`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:06.842937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.881123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 891/1740] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:06.886600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:06.890672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040312bb-35ee-417c-aed8-3a71a0698797 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:06.895108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:06.901054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:06.902068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.902651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.903336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] PATH_INFO: `/v3/projects/99828b1c56854256a989d43881a6b9e4/users/95846bf9967e4abfb2dd90d3ec157578/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.932486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99828b1c56854256a989d43881a6b9e4, user_id=95846bf9967e4abfb2dd90d3ec157578, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:06.952482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:06.957324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cd0d-07c9-4579-9360-4860e06e934b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:06.977353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:06.978362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:06.978651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:06.978930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] PATH_INFO: `/v3/projects/482a86d536904d28bf5e134e1d2b2c84` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:06.982060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=482a86d536904d28bf5e134e1d2b2c84)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:06.986045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:06.987793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 850/1741] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:06 2022] PUT /identity/v3/projects/99828b1c56854256a989d43881a6b9e4/users/95846bf9967e4abfb2dd90d3ec157578/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:07.003243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:07.005618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.149751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff779-0a3e-413f-93e9-e670d6cc67a8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:07.150904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482a86d536904d28bf5e134e1d2b2c84', 'request_id': 'req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:07.177249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482a86d536904d28bf5e134e1d2b2c84', 'request_id': 'req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:07.202241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482a86d536904d28bf5e134e1d2b2c84', 'request_id': 'req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:07.227888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] The token cache is being invalidate because project 482a86d536904d28bf5e134e1d2b2c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:07.228192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:07.228878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:07.232565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 892/1742] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:06 2022] DELETE /identity/v3/projects/482a86d536904d28bf5e134e1d2b2c84 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:07.237952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:07.239499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.343307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:07.344264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:07.344859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:07.345293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:07.354166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.361073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb56bd8-baeb-4180-a1e9-eca84cb2ea7b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:07.371524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:07.372037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:07.373446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:07.373787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:07.376808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.387352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:07.394237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd57e21-aee2-4796-9406-67550b3449e1 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:07.407288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:07.463032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 851/1743] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:07.466913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:07.467204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:07.467990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:07.498446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:07.516772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb73e1-4f43-4040-8d71-3389d960f4ea service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:07.543016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 893/1744] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:07.547477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97835d-a29f-44cb-96c4-ac6b6766f60e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:07.548186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97835d-a29f-44cb-96c4-ac6b6766f60e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:07.548467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97835d-a29f-44cb-96c4-ac6b6766f60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:07.560226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] MFA Rules not processed for user `95846bf9967e4abfb2dd90d3ec157578`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:07.561439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.585652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ec97835d-a29f-44cb-96c4-ac6b6766f60e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:07.587947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ec97835d-a29f-44cb-96c4-ac6b6766f60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.770177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 852/1745] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:07.774586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:07.776027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.789986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 894/1746] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:07.790896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:07.792528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:07.802724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3e875-36d0-40f5-a6e0-2a92266c2e42 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:07.803353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:07.803862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:07.813369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:07.814056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:07.814347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:07.814628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:07.815324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:07.817383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:07.854720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:07.856264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:07.880218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 853/1747] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:07 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:07.885715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:07.910549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 895/1748] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:07.913723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:07.993628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740aa59-5b22-46cc-a1d2-b6e650a4c6ad None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.075748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f8b75-6c15-4120-8a9a-6e944cfe47aa admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.080698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.081405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.081680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.081961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.082672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.084688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.133869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 854/1749] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:07 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:08.137602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.154339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.155187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.155722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.156176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.157750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:08.157750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.159802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.165671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b743fbf-b7c5-4689-b88a-7e06e9b4b501 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.178448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 896/1750] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:08.182988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.183278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.184213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.184450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.189367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.190254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.191960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.226513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 855/1751] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:38:08.230623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.242021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc6a52-a911-4311-9699-c926663a9d69 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.250126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f89d5-51cb-4a11-8c02-9eee7690223e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.265727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.266687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.266938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.267222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] PATH_INFO: `/v3/projects/d18b59e3637e4bde95bc410ebe047848/users/c07c0c4ac8d941f6979c136c7bca5682/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.268585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.278126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.280626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.280826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.281566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.298745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.303354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18b59e3637e4bde95bc410ebe047848, user_id=c07c0c4ac8d941f6979c136c7bca5682, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.306166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.357630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 856/1752] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:08 2022] PUT /identity/v3/projects/d18b59e3637e4bde95bc410ebe047848/users/c07c0c4ac8d941f6979c136c7bca5682/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:08.358812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.400389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 897/1753] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:08 2022] POST /identity/v3/projects => generated 389 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:08.413872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.521962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:08.618694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390d08-8e35-45be-a1b8-c28de02f7caa admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.630152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.631032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.631032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.631352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.632145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.634067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.639305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf5c4-9b82-4133-a26d-b21759b781ec admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.662032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.662738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.663026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.663301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.664314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.668011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 857/1754] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:38:08.668174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.679062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.727001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bdb60-ef1a-4837-ab8a-81259fcc420a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.745445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 898/1755] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:08 2022] POST /identity/v3/users => generated 295 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:08.751646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782d68-7ef1-4459-ae8f-49cdb98299e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:08.751900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:08.756179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782d68-7ef1-4459-ae8f-49cdb98299e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.756526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782d68-7ef1-4459-ae8f-49cdb98299e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.756813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782d68-7ef1-4459-ae8f-49cdb98299e2 admin admin] PATH_INFO: `/v3/projects/d18b59e3637e4bde95bc410ebe047848/users/c07c0c4ac8d941f6979c136c7bca5682/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.763799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782d68-7ef1-4459-ae8f-49cdb98299e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18b59e3637e4bde95bc410ebe047848, user_id=c07c0c4ac8d941f6979c136c7bca5682, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:08.766614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782d68-7ef1-4459-ae8f-49cdb98299e2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:08.794602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7282-5ac9-4f3c-9b94-84e677928c2c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:08.818268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 858/1756] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:08 2022] PUT /identity/v3/projects/d18b59e3637e4bde95bc410ebe047848/users/c07c0c4ac8d941f6979c136c7bca5682/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:08.819339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:08.819639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:08.819952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:08.916231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] MFA Rules not processed for user `c07c0c4ac8d941f6979c136c7bca5682`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:08.917477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:08.926645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:09.007484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:09.008977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.009317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.009602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.017014 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:09.019638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:09.072981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 899/1757] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:09.078651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:09.112948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2829-9ec5-483a-b7d1-9704209a298d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:09.145867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:09.146562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.151734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.152270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.153211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:09.156245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:09.182998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 859/1758] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:09.191576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:09.193181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:09.203615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 900/1759] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:09.204582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:09.239261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39587f-0593-4eab-884f-099787345cd6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:09.264843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c2107-3b61-45d1-a70c-f5b256b0fb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:09.271361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c2107-3b61-45d1-a70c-f5b256b0fb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.271992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c2107-3b61-45d1-a70c-f5b256b0fb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.272486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c2107-3b61-45d1-a70c-f5b256b0fb6d admin admin] PATH_INFO: `/v3/projects/5bf0aadeee0e4c2a95e2cc2e69a8663f/users/f82da5a2305a4f8cb1d87837bd287ed2/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.316391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c2107-3b61-45d1-a70c-f5b256b0fb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf0aadeee0e4c2a95e2cc2e69a8663f, user_id=f82da5a2305a4f8cb1d87837bd287ed2, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:09.319821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c2107-3b61-45d1-a70c-f5b256b0fb6d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:09.360005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 901/1760] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:09 2022] PUT /identity/v3/projects/5bf0aadeee0e4c2a95e2cc2e69a8663f/users/f82da5a2305a4f8cb1d87837bd287ed2/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:09.370531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.371124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.371600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.377239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d98fa-55eb-4686-ae92-808783d489b0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:09.455684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] MFA Rules not processed for user `f82da5a2305a4f8cb1d87837bd287ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:09.457244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:09.535885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774db29-bf48-4ace-9e5f-1eb1a9f4712f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:09.539774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774db29-bf48-4ace-9e5f-1eb1a9f4712f service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.540179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774db29-bf48-4ace-9e5f-1eb1a9f4712f service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.540570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774db29-bf48-4ace-9e5f-1eb1a9f4712f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.674651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 902/1761] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:09.675791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:09.717567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:09.738918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774db29-bf48-4ace-9e5f-1eb1a9f4712f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:09.741210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774db29-bf48-4ace-9e5f-1eb1a9f4712f service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:09.786943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 860/1762] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:09.793764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157b85-34c5-4fc7-948b-099c88f86164 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.794951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157b85-34c5-4fc7-948b-099c88f86164 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.797999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157b85-34c5-4fc7-948b-099c88f86164 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.808692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 861/1763] 10.222.0.18 () {54 vars in 960 bytes} [Wed Jun 22 18:38:09 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:38:09.810606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092bb62-9531-4689-8618-c51f1698aa60 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:09.820018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092bb62-9531-4689-8618-c51f1698aa60 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:09.823608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092bb62-9531-4689-8618-c51f1698aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:09.984875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a092bb62-9531-4689-8618-c51f1698aa60 None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:09.987773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a092bb62-9531-4689-8618-c51f1698aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:10.005646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:10.011502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ca161-f966-4450-a20c-1463f541b8c5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:10.024689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:10.027383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.027785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.028211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.030879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:10.040799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:10.108177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 903/1764] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:09 2022] POST /identity/v3/projects => generated 389 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:10.108177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:10.182686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 862/1765] 10.222.0.18 () {58 vars in 1057 bytes} [Wed Jun 22 18:38:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:10.184138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209ba6-159e-460c-968f-6e549a28252b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.184449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209ba6-159e-460c-968f-6e549a28252b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.185399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209ba6-159e-460c-968f-6e549a28252b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.191986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 863/1766] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 18:38:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:38:10.193061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc209ba6-159e-460c-968f-6e549a28252b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:10.284039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962fee0-3619-4f5f-807d-3a06736412c6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:10.291878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:10.292967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.296005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.296426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] PATH_INFO: `/v3/users/95846bf9967e4abfb2dd90d3ec157578` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.300107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95846bf9967e4abfb2dd90d3ec157578)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:10.304712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:10.392239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc209ba6-159e-460c-968f-6e549a28252b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:10.404415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:10.405104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.405438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.405717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.406449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:10.408507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:10.425885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95846bf9967e4abfb2dd90d3ec157578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:10.460514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 864/1767] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:10 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:10.462450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:10.480548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95846bf9967e4abfb2dd90d3ec157578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:10.525374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95846bf9967e4abfb2dd90d3ec157578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:10.526310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95846bf9967e4abfb2dd90d3ec157578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:10.541233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fa623665-55be-4600-8722-bdda38f69882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95846bf9967e4abfb2dd90d3ec157578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:10.558265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 904/1768] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:10 2022] DELETE /identity/v3/users/95846bf9967e4abfb2dd90d3ec157578 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:10.566906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.567946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.568488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.612214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:10.618699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:10.633269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:10.649681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1393b-4e29-40f7-84b0-276711a2c4b7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:10.729040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:10.749117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 905/1769] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:10.750689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:10.754085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:10.820123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:10.821888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.822290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.822895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.831725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:10.869827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:10.871789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384e6ca-496b-4fd9-b30c-d13da46755ef service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:10.884965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48ba6-b67d-4922-b3ff-014c16719819 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:10.891037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:10.891730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.892058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.892184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 865/1770] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:10.892381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.893354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:10.894667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da479315-975f-4bef-a1d2-09a83ecc11a2 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.895569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da479315-975f-4bef-a1d2-09a83ecc11a2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.895761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:10.895883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da479315-975f-4bef-a1d2-09a83ecc11a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.911768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 906/1771] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:10.911768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:10.921875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:10.941079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-da479315-975f-4bef-a1d2-09a83ecc11a2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:10.942341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-da479315-975f-4bef-a1d2-09a83ecc11a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:10.954418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b53d23-69aa-465b-8706-5e08726f0237 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:10.957184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 866/1772] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:10.958505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.958795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.959094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.968204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:10.970696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:10.971488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:10.972042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:10.983914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:10.987800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:11.004207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 907/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:11.006354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] MFA Rules not processed for user `8978ed54252843f78b0d00d37b475ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:11.007616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:11.014484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:11.050283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52011651-1ca3-42cd-8ce2-ca8609aaa18d service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:11.062814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:11.066228 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:11.066538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:11.067389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] PATH_INFO: `/v3/projects/1edae8042aea44aaad5aaf1f22c4b73e/users/245b1736277e492aa505cc2afcb68f40/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:11.139624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1edae8042aea44aaad5aaf1f22c4b73e, user_id=245b1736277e492aa505cc2afcb68f40, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:11.148329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:11.150375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 867/1774] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:11.151264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:11.192958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a340240-37b0-4673-bcbd-086503f0de27 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:11.200058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 908/1775] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:11 2022] PUT /identity/v3/projects/1edae8042aea44aaad5aaf1f22c4b73e/users/245b1736277e492aa505cc2afcb68f40/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:11.202423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:11.303559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:11.305374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:11.306662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:11.307197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:11.400382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb6ef8-e851-4c04-a4d9-1617494bc283 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:11.412321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43282302-d8f2-42f6-aa19-021b4b0189a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:11.414118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282302-d8f2-42f6-aa19-021b4b0189a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:11.414655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282302-d8f2-42f6-aa19-021b4b0189a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:11.417672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282302-d8f2-42f6-aa19-021b4b0189a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:11.421700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43282302-d8f2-42f6-aa19-021b4b0189a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:11.427955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43282302-d8f2-42f6-aa19-021b4b0189a0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:11.461325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 909/1776] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:11.464418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:11.466499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:11.466926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:11.468172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:11.468761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:11.492973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 868/1777] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:11.493856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:11.516666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b29c6-3354-4a04-a109-b27aa16ec7b3 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:11.522182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] MFA Rules not processed for user `d32582f1a1994e3b9c05f56185d0079d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:11.525713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:11.530794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd7899-3ae8-498c-beb5-fcc58bf47255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:11.531711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd7899-3ae8-498c-beb5-fcc58bf47255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:11.532045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd7899-3ae8-498c-beb5-fcc58bf47255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:11.532329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd7899-3ae8-498c-beb5-fcc58bf47255 admin admin] PATH_INFO: `/v3/projects/1edae8042aea44aaad5aaf1f22c4b73e/users/245b1736277e492aa505cc2afcb68f40/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:11.536022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd7899-3ae8-498c-beb5-fcc58bf47255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1edae8042aea44aaad5aaf1f22c4b73e, user_id=245b1736277e492aa505cc2afcb68f40, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:11.538797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd7899-3ae8-498c-beb5-fcc58bf47255 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:11.556397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:11.564662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 869/1778] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:11 2022] PUT /identity/v3/projects/1edae8042aea44aaad5aaf1f22c4b73e/users/245b1736277e492aa505cc2afcb68f40/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:11.574887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:11.575404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:11.575770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:11.582075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:11.631775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] MFA Rules not processed for user `245b1736277e492aa505cc2afcb68f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:11.633367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:11.679038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 910/1779] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:11.886447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 870/1780] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:11.899714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:11.901278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:12.067788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51e4a0-2c8a-4f3c-8dc4-99acfb055555 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:12.217843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:12.218729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:12.221531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:12.222101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:12.244476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:12.245979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:12.295215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 911/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:12.532419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:12.534149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:12.567112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:12.708086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30852a6f-2aad-4de3-96aa-ec9ff6156638 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:12.732470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:12.733287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:12.733573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:12.733855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] PATH_INFO: `/v3/projects/99828b1c56854256a989d43881a6b9e4` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:12.735122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=99828b1c56854256a989d43881a6b9e4)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:12.737121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:12.747333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db481236-706b-4865-9d37-bd1e5a9a0330 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:12.752952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:12.754171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:12.754726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:12.755229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] PATH_INFO: `/v3/users/f82da5a2305a4f8cb1d87837bd287ed2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:12.756788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82da5a2305a4f8cb1d87837bd287ed2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:12.759321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:12.800434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:12.844963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99828b1c56854256a989d43881a6b9e4', 'request_id': 'req-d684f191-c577-421e-871e-118c02734f8e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.856133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99828b1c56854256a989d43881a6b9e4', 'request_id': 'req-d684f191-c577-421e-871e-118c02734f8e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.871781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99828b1c56854256a989d43881a6b9e4', 'request_id': 'req-d684f191-c577-421e-871e-118c02734f8e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.881539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82da5a2305a4f8cb1d87837bd287ed2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.906645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] The token cache is being invalidate because project 99828b1c56854256a989d43881a6b9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:12.907216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.907625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d684f191-c577-421e-871e-118c02734f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.909552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 871/1782] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:12 2022] DELETE /identity/v3/projects/99828b1c56854256a989d43881a6b9e4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:12.910837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032733a-09df-4368-a9f3-e1c6c14cfa0a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:12.911122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032733a-09df-4368-a9f3-e1c6c14cfa0a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:12.911409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032733a-09df-4368-a9f3-e1c6c14cfa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:12.926989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82da5a2305a4f8cb1d87837bd287ed2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.947714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82da5a2305a4f8cb1d87837bd287ed2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.948696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82da5a2305a4f8cb1d87837bd287ed2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.962731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9032733a-09df-4368-a9f3-e1c6c14cfa0a None None] MFA Rules not processed for user `94d5713dc97f442f916b22d925c35042`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:12.966353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82da5a2305a4f8cb1d87837bd287ed2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:12.967336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9032733a-09df-4368-a9f3-e1c6c14cfa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:12.988195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 912/1783] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:12 2022] DELETE /identity/v3/users/f82da5a2305a4f8cb1d87837bd287ed2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:38:12.990377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:12.993035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:13.021176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:13.239487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 872/1784] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:13.241056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:13.241349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:13.241684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:13.332613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:13.334158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8971-52e0-413c-8140-2211c182e332 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:13.339025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:13.370012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:13.370932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:13.371222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:13.371503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] PATH_INFO: `/v3/users/c07c0c4ac8d941f6979c136c7bca5682` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:13.381415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07c0c4ac8d941f6979c136c7bca5682)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:13.398619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:13.400741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 873/1785] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:13.402954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:13.405345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:13.577980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07c0c4ac8d941f6979c136c7bca5682'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:13.639792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07c0c4ac8d941f6979c136c7bca5682'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:13.670477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07c0c4ac8d941f6979c136c7bca5682'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:13.671374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07c0c4ac8d941f6979c136c7bca5682'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:13.690938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07c0c4ac8d941f6979c136c7bca5682'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:13.728439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 913/1786] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:12 2022] DELETE /identity/v3/users/c07c0c4ac8d941f6979c136c7bca5682 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:13.756988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827a3c-b12b-469d-94b3-4555d5930ff9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:13.924449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:13.925800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:13.925800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:13.925968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:13.937151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:14.087405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:14.090014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517f065-255c-4103-a44a-b5930b6a8795 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:14.105785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 874/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:14.753947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:14.756089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:14.781880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c9cd3-ce44-47cb-80ae-33c72f2bd8d2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:14.797126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:14.798303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:14.798741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:14.799167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] PATH_INFO: `/v3/projects/d18b59e3637e4bde95bc410ebe047848` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:14.801057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18b59e3637e4bde95bc410ebe047848)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:14.803255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:14.837850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:14.909206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18b59e3637e4bde95bc410ebe047848', 'request_id': 'req-395dcb51-8d0d-4c0e-8b03-01b8b54be613'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:14.922023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18b59e3637e4bde95bc410ebe047848', 'request_id': 'req-395dcb51-8d0d-4c0e-8b03-01b8b54be613'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:14.930733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18b59e3637e4bde95bc410ebe047848', 'request_id': 'req-395dcb51-8d0d-4c0e-8b03-01b8b54be613'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:14.960400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] The token cache is being invalidate because project d18b59e3637e4bde95bc410ebe047848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:14.960953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:14.962017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-395dcb51-8d0d-4c0e-8b03-01b8b54be613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:14.964106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 914/1788] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:14 2022] DELETE /identity/v3/projects/d18b59e3637e4bde95bc410ebe047848 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:14.968774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:14.969756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:14.970577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:14.996856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:14.999698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:15.022919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:15.086982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 875/1789] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:15.093560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.094194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.094486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.136499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:15.143222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:15.159270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 915/1790] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:15.164768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.175991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c83d-34be-42fb-b5d2-82d5eefe6449 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.193430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.194235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.194528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.194809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.196782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:15.197157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.203035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.244705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 876/1791] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:15.248022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.259620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103dc6a-8e9d-4abd-8a91-68ead37e1d06 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.272548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.275387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.277738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.279020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.282268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.285904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.287077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.287792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:15.308731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599308d-3e95-4619-a5fd-a1f4c21ab09d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.316283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.317277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.317563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.317847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] PATH_INFO: `/v3/projects/5bf0aadeee0e4c2a95e2cc2e69a8663f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.319087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf0aadeee0e4c2a95e2cc2e69a8663f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.321213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.359590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 916/1792] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:15 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:15.361094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.394673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf0aadeee0e4c2a95e2cc2e69a8663f', 'request_id': 'req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.406189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf0aadeee0e4c2a95e2cc2e69a8663f', 'request_id': 'req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.442031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf0aadeee0e4c2a95e2cc2e69a8663f', 'request_id': 'req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.450995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cab5b2-2092-4fd4-ac92-106a0d22722e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.470951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] The token cache is being invalidate because project 5bf0aadeee0e4c2a95e2cc2e69a8663f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:15.471257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.472259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.475028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 877/1793] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:15 2022] DELETE /identity/v3/projects/5bf0aadeee0e4c2a95e2cc2e69a8663f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:38:15.480731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.488346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:15.539213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.542346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.542812 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.544246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.546374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.549973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.590900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 917/1794] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:15 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:15.595884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.598860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:15.624868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bb29-2ff0-40bb-8ebb-00e17b22e723 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.634687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.635600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.636410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.636848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.637786 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.640953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.643875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:15.652057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6067cd-fc5b-4d6c-b1a7-f722ee1028a5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.658502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.659660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.660084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.660567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] PATH_INFO: `/v3/users/245b1736277e492aa505cc2afcb68f40` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.662687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=245b1736277e492aa505cc2afcb68f40)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.665317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.674372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 918/1795] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:15.675452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.697182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6880c4-bbbb-4562-8e2c-83465ab9fea2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.710012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.710882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.711267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.712526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.713064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.714916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.739505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:15.774757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245b1736277e492aa505cc2afcb68f40'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.789633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 919/1796] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:15.791190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:15.796120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245b1736277e492aa505cc2afcb68f40'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.812098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d257c-011f-412e-acfc-5ee337e87aaa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:15.813641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245b1736277e492aa505cc2afcb68f40'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.815170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245b1736277e492aa505cc2afcb68f40'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.817382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a8f28000-b1c6-4998-b990-f40ef092d4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245b1736277e492aa505cc2afcb68f40'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:15.818698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:15.820689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.821706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.822217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] PATH_INFO: `/v3/projects/2bd4da26fd7b47af97f536d1b95b01fb/users/d8a4ba4f521341a9807ab08e123986d0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.845251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd4da26fd7b47af97f536d1b95b01fb, user_id=d8a4ba4f521341a9807ab08e123986d0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:15.848829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:15.861156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 878/1797] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:15 2022] DELETE /identity/v3/users/245b1736277e492aa505cc2afcb68f40 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:15.900450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 920/1798] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:15 2022] PUT /identity/v3/projects/2bd4da26fd7b47af97f536d1b95b01fb/users/d8a4ba4f521341a9807ab08e123986d0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:15.915594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:15.915939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:15.916278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:15.990806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] MFA Rules not processed for user `d8a4ba4f521341a9807ab08e123986d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:16.004537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.136461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 879/1799] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:16.140758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.142823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.271922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da990396-d1bc-4efb-b0e9-06900edefa27 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.279067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.279964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.280254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.280531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.281250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.283268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.317488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 921/1800] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:16.329883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.346086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcda6a-e49d-41b6-8a2a-9d5ab3e1eab3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.447796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.448623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.449172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.449277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.450572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.452880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.492093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 880/1801] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:16.495297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.509180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdc9f2-e623-432a-a356-6b89693b1c9a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.516876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.518593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.518888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.519354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.520209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.521968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.533822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.536028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.549813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20f904-4d13-4386-8d6b-384f126a0c87 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.550471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 922/1802] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:16.557882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.559105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.560338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.560833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.561313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] PATH_INFO: `/v3/projects/1edae8042aea44aaad5aaf1f22c4b73e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.562924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1edae8042aea44aaad5aaf1f22c4b73e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.565216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.569548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2953a1-6098-4bdb-8fcd-fb0f5f8e980c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.574320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.576365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.576672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.576935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.577674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.579317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.591959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 923/1803] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:16.596837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.603752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:16.609436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574502-21c5-4531-aad2-32d839bfaa41 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.626482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1edae8042aea44aaad5aaf1f22c4b73e', 'request_id': 'req-808c0232-ff74-493f-8945-41e2a5d267b0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:16.636894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1edae8042aea44aaad5aaf1f22c4b73e', 'request_id': 'req-808c0232-ff74-493f-8945-41e2a5d267b0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:16.645739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1edae8042aea44aaad5aaf1f22c4b73e', 'request_id': 'req-808c0232-ff74-493f-8945-41e2a5d267b0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:16.660956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] The token cache is being invalidate because project 1edae8042aea44aaad5aaf1f22c4b73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:16.661365 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:16.662450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-808c0232-ff74-493f-8945-41e2a5d267b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:16.664847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 881/1804] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:16 2022] DELETE /identity/v3/projects/1edae8042aea44aaad5aaf1f22c4b73e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:16.670338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6012-2ca6-4208-828c-df27c1e1911f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.671005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6012-2ca6-4208-828c-df27c1e1911f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.671489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6012-2ca6-4208-828c-df27c1e1911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.681793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f9bf5-6bb0-4372-a211-511117fbfa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.682926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9bf5-6bb0-4372-a211-511117fbfa54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.683279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9bf5-6bb0-4372-a211-511117fbfa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.683624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9bf5-6bb0-4372-a211-511117fbfa54 admin admin] PATH_INFO: `/v3/projects/b3942dd3a0f84e2ca50b18a5971a331a/users/12f5671c44474070acaaa32cac081fa5/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.690804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4b9e6012-2ca6-4208-828c-df27c1e1911f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:16.692045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4b9e6012-2ca6-4208-828c-df27c1e1911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.700301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 882/1805] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:16.700870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f9bf5-6bb0-4372-a211-511117fbfa54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3942dd3a0f84e2ca50b18a5971a331a, user_id=12f5671c44474070acaaa32cac081fa5, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.703478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f9bf5-6bb0-4372-a211-511117fbfa54 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.709511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.709984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.710348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.720638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 924/1806] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:16 2022] PUT /identity/v3/projects/b3942dd3a0f84e2ca50b18a5971a331a/users/12f5671c44474070acaaa32cac081fa5/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:16.731967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:16.732834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.733134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.733326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.733403 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.753751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:16.766393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] MFA Rules not processed for user `12f5671c44474070acaaa32cac081fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:16.767658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.809780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 883/1807] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:16.814653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.823695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3bb43-d7e3-4e1e-87dc-1bbae91201aa None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.828845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.829515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.829805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.830088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.830840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:16.831151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.833081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.842147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 925/1808] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:16.846437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.847777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:16.850132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 884/1809] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:38:16.851050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.862221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9edac9-3389-4273-af2c-8e19673449dc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.862635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65835699-d7e2-4d23-87ae-7552c6a2abae None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.866807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.867116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.867454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.867743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.867902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.868056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.868163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.868334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.868750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.869127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.870657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.871045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.900605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 885/1810] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:16.900782 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 926/1811] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:16.901342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.901780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:16.973122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c1f4-4bff-4ef1-80e4-a9ad99d0fe67 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.973644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f322f-866d-4755-84ba-e14c564fed6e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:16.985762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.986443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.986730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.987011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.987214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:16.987722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.987920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:16.988210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:16.988489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:16.989182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:16.989811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:16.991157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.012208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 886/1812] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:17.016227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.018328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 927/1813] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:16 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:17.021454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:17.022233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.029010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cd0b3-fa2e-428a-9a16-c281030390d3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.035761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbb963-5cee-4d96-9eac-22ed37b19115 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.036615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.037774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.038067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.038347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.040737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.041721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.042376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.042493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.042704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.042991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.043798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.045487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.061123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 887/1814] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:38:17.062397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.066424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 928/1815] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:38:17.068505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.073535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68e754-eb2c-4276-9473-d0e11e9d1c43 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.079204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.080262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.080656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.081069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] PATH_INFO: `/v3/projects/c4bd40518de141649dc42f0ce311881b/users/8ecd32ff659d4a51b770c9d5f4813030/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.081586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d926e5d-2077-411c-b581-1bb4bd75c2af admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.086738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.087416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.087711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.088030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.088847 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.090895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.098745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bd40518de141649dc42f0ce311881b, user_id=8ecd32ff659d4a51b770c9d5f4813030, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.101612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.104030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 929/1816] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:17.109268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.122790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f716572-272a-495e-a19e-af18ce9e016c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.122974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 888/1817] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:17 2022] PUT /identity/v3/projects/c4bd40518de141649dc42f0ce311881b/users/8ecd32ff659d4a51b770c9d5f4813030/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:17.127031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.174521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:17.192403 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094f70-4196-4dac-beb8-c41dfc218327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.193310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094f70-4196-4dac-beb8-c41dfc218327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.193598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094f70-4196-4dac-beb8-c41dfc218327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.193887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094f70-4196-4dac-beb8-c41dfc218327 admin admin] PATH_INFO: `/v3/projects/874d271c83f24e54916494a40e473305/users/59c186d3cc9243b0956ecd2cc6b1f951/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.208910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eb2f6-6bcc-4880-82ac-ebd1b1ad6ba9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.213662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.214330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.214620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.214896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.216367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.217506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094f70-4196-4dac-beb8-c41dfc218327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d271c83f24e54916494a40e473305, user_id=59c186d3cc9243b0956ecd2cc6b1f951, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.217998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.220540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094f70-4196-4dac-beb8-c41dfc218327 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.228554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 889/1818] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:17.235241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.242225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 930/1819] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:17 2022] PUT /identity/v3/projects/874d271c83f24e54916494a40e473305/users/59c186d3cc9243b0956ecd2cc6b1f951/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:17.245829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca64047-2a70-4205-b98e-88eba969a6fc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.252650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.252941 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.253223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.281999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] MFA Rules not processed for user `59c186d3cc9243b0956ecd2cc6b1f951`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:17.283480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:17.308435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87f312-98c7-4033-a9b7-f120e43c8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.309412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87f312-98c7-4033-a9b7-f120e43c8787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.309704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87f312-98c7-4033-a9b7-f120e43c8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.310427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87f312-98c7-4033-a9b7-f120e43c8787 admin admin] PATH_INFO: `/v3/projects/c4bd40518de141649dc42f0ce311881b/users/8ecd32ff659d4a51b770c9d5f4813030/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.312324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87f312-98c7-4033-a9b7-f120e43c8787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bd40518de141649dc42f0ce311881b, user_id=8ecd32ff659d4a51b770c9d5f4813030, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.315375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87f312-98c7-4033-a9b7-f120e43c8787 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.327642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 890/1820] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:17 2022] PUT /identity/v3/projects/c4bd40518de141649dc42f0ce311881b/users/8ecd32ff659d4a51b770c9d5f4813030/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:17.337959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.338756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.339216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.361501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 931/1821] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:17.371316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] MFA Rules not processed for user `8ecd32ff659d4a51b770c9d5f4813030`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:17.373686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:17.374037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.375787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:17.425983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:17.446199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c7e2a-d918-4169-914c-97db04c8e864 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.467828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 891/1822] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:17.476074 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:17.478065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:17.543332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.548505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.549620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.550049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.594675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:17.596009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375305-721a-4272-bb92-4c212d82da3b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:17.601487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:17.606829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:17.607392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:17.607757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:17.620586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.622859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.634144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 892/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:38:17.642450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:17.644092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:17.672145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 932/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:38:18.545370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:18.553998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520a85-5cee-43a5-9500-1adf7bff263b service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:18.557685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:18.558370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:18.558643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:18.558949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:18.561113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:18.623987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:18.625438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19efa6f-a089-4215-90dc-81392aa6eef2 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:18.634633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 893/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:38:18.779236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:18.789066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05193509-da3b-4b56-beef-9e5376b6faa1 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:18.795202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:18.796172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:18.798004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:18.798728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:18.801768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:18.893214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:18.894600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:18.905493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 933/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:19.879889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:19.880808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:19.881266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:19.918880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:19.922753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:20.050599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 894/1827] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:38:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:20.287613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:20.289158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:20.390176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bdec-9404-461f-83da-f498b18d2be2 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:20.402271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366c417-9ace-4082-a832-7906f54c6725 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:20.405454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c417-9ace-4082-a832-7906f54c6725 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:20.406148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c417-9ace-4082-a832-7906f54c6725 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:20.406148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c417-9ace-4082-a832-7906f54c6725 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:20.417986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366c417-9ace-4082-a832-7906f54c6725 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:20.419821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366c417-9ace-4082-a832-7906f54c6725 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:20.429212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 934/1828] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:38:30.041576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:30.425923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=77 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:33.555223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:33.566753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220940e-c2ca-42b4-b186-44656a1c71f7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:33.570767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:33.571575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:33.571879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:33.572179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:33.644363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:33.645833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:33.656301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 895/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:38.365956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:38.366451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:38.366703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:38.387521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:38.388845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:38.447082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 935/1830] 10.222.0.44 () {58 vars in 1015 bytes} [Wed Jun 22 18:38:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:38.639854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:38.641649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:38.657766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6add46-82fb-4526-828f-cb1e24c4ee73 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:38.662482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62035534-79b7-4452-97b2-ceff968fd6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:38.663268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035534-79b7-4452-97b2-ceff968fd6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:38.663664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035534-79b7-4452-97b2-ceff968fd6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:38.664107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035534-79b7-4452-97b2-ceff968fd6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:38.673844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62035534-79b7-4452-97b2-ceff968fd6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:38.675705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62035534-79b7-4452-97b2-ceff968fd6c9 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:38.686624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 896/1831] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:40.491722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:40.707062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893b9a-55ef-48d4-8470-1f50b09b2cf5 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:40.708105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893b9a-55ef-48d4-8470-1f50b09b2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:40.708576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893b9a-55ef-48d4-8470-1f50b09b2cf5 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:40.711159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 897/1832] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:38:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:38:40.756933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5acbc8-1351-4432-a4db-b881bac1af61 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:40.788994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:40.790198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:40.790715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:40.791170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] PATH_INFO: `/v3/users/59c186d3cc9243b0956ecd2cc6b1f951` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:40.793784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c186d3cc9243b0956ecd2cc6b1f951)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:40.796666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:40.809428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f9c9-e75d-47c6-984f-498c1c121dbd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:40.809721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f9c9-e75d-47c6-984f-498c1c121dbd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:40.811348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f9c9-e75d-47c6-984f-498c1c121dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:40.875029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1072f9c9-e75d-47c6-984f-498c1c121dbd None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:40.877197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1072f9c9-e75d-47c6-984f-498c1c121dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:40.953132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c186d3cc9243b0956ecd2cc6b1f951'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:40.983877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c186d3cc9243b0956ecd2cc6b1f951'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.003924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c186d3cc9243b0956ecd2cc6b1f951'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.004760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c186d3cc9243b0956ecd2cc6b1f951'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.027036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c186d3cc9243b0956ecd2cc6b1f951'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.046089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 936/1833] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:40 2022] DELETE /identity/v3/users/59c186d3cc9243b0956ecd2cc6b1f951 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:41.048739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:41.054298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:41.128874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:41.131770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 898/1834] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:38:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:41.143236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:41.143576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:41.143900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:41.174686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:41.176186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:41.230736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb72a5-f375-452e-a135-fad2d6ec22ed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:41.243755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:41.244698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:41.247746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:41.248162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] PATH_INFO: `/v3/users/d8a4ba4f521341a9807ab08e123986d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:41.251325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a4ba4f521341a9807ab08e123986d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:41.254427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:41.273677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 899/1835] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:41.359934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a4ba4f521341a9807ab08e123986d0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.378481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a4ba4f521341a9807ab08e123986d0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.391896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:41.394345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:41.397841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a4ba4f521341a9807ab08e123986d0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.399243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a4ba4f521341a9807ab08e123986d0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.411302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8f67ab27-807c-4edd-97ef-00c925137d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a4ba4f521341a9807ab08e123986d0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:41.421045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 937/1836] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:41 2022] DELETE /identity/v3/users/d8a4ba4f521341a9807ab08e123986d0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:41.430346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:41.432934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:41.433683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:41.460116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:41.501669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:41.503843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:41.539582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31b9a-162f-4c7a-8e8a-11e1f61c4ea6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:41.637768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:41.640068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:41.640739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:41.641086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:41.644254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:41.652277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 938/1837] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:41.659795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:41.661277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b054255-64a9-440f-a9ba-b1956b9583db service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:41.675310 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 900/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:41.688966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:41.691171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:41.709164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a415f36-2e1a-493b-8b5b-e4d4ec0625f6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:41.713016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2717-19c4-48f2-af46-3de0797e9ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:41.714253 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2717-19c4-48f2-af46-3de0797e9ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:41.714747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2717-19c4-48f2-af46-3de0797e9ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:41.715139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2717-19c4-48f2-af46-3de0797e9ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:41.728144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2717-19c4-48f2-af46-3de0797e9ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:41.729737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2717-19c4-48f2-af46-3de0797e9ea8 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:41.743631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 939/1839] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:41.980350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b91e97-6e55-44c6-9d64-6ce7f6e74713 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:41.981568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b91e97-6e55-44c6-9d64-6ce7f6e74713 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:41.982514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b91e97-6e55-44c6-9d64-6ce7f6e74713 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:41.984190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 901/1840] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:38:42.010973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:42.012516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:42.013603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:42.062596 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:42.067193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:42.144118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:42.155202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b91e97-6e55-44c6-9d64-6ce7f6e74713 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:42.157770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-65b91e97-6e55-44c6-9d64-6ce7f6e74713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:42.192582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 940/1841] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:38:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:42.282019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:42.285233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:42.305708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5d81e-a62d-4ac6-8d00-07bf4f291beb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:42.318920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:42.320568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:42.321384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:42.322218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:42.345322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:42.348508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:42.371142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 941/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:38:42.373758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b91e97-6e55-44c6-9d64-6ce7f6e74713 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:42.384231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:42.384907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:42.385196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:42.385478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:42.388618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:42.405983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:42.407851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:42.423176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 902/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:42.459497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:42.461491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:42.532647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24c8ea-a872-4333-9db3-717feacfdbf0 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:42.550194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:42.554098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:42.554386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:42.554671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] PATH_INFO: `/v3/projects/2bd4da26fd7b47af97f536d1b95b01fb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:42.557032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd4da26fd7b47af97f536d1b95b01fb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:42.577479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:42.742553 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd4da26fd7b47af97f536d1b95b01fb', 'request_id': 'req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:42.754483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd4da26fd7b47af97f536d1b95b01fb', 'request_id': 'req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:42.762816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd4da26fd7b47af97f536d1b95b01fb', 'request_id': 'req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:42.798761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] The token cache is being invalidate because project 2bd4da26fd7b47af97f536d1b95b01fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:42.799066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:42.800200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:42.802703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 942/1844] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:42 2022] DELETE /identity/v3/projects/2bd4da26fd7b47af97f536d1b95b01fb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:42.806421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:42.821449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0631f-b292-4dbf-a64b-9151ad042b9d service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:42.975691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:42.982012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:42.982624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:42.985031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] PATH_INFO: `/v3/users/12f5671c44474070acaaa32cac081fa5` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:42.990922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f5671c44474070acaaa32cac081fa5)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.015181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.024233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.025710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:43.051072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:43.053911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155abd7-cb5f-4f9e-9402-d0a52b84d7ce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.070775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.072288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.084372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.084664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] PATH_INFO: `/v3/projects/874d271c83f24e54916494a40e473305` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.088320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874d271c83f24e54916494a40e473305)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.095702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.196529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f5671c44474070acaaa32cac081fa5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.228631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874d271c83f24e54916494a40e473305', 'request_id': 'req-b7e8c49b-9778-4972-aedc-965bc99decd9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.249224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874d271c83f24e54916494a40e473305', 'request_id': 'req-b7e8c49b-9778-4972-aedc-965bc99decd9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.251704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f5671c44474070acaaa32cac081fa5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.266046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f5671c44474070acaaa32cac081fa5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.267280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f5671c44474070acaaa32cac081fa5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.270521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5375b82c-911b-4412-abd2-adcf37e587b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f5671c44474070acaaa32cac081fa5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.284366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874d271c83f24e54916494a40e473305', 'request_id': 'req-b7e8c49b-9778-4972-aedc-965bc99decd9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.294432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 903/1845] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:42 2022] DELETE /identity/v3/users/12f5671c44474070acaaa32cac081fa5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:43.316401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] The token cache is being invalidate because project 874d271c83f24e54916494a40e473305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:43.316690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.317361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7e8c49b-9778-4972-aedc-965bc99decd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:43.319232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 943/1846] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:43 2022] DELETE /identity/v3/projects/874d271c83f24e54916494a40e473305 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:43.324389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.324745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.325093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.349685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:43.351163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:43.447983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 904/1847] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:43.451217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.451696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.452691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.476866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:43.476866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:43.487756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 944/1848] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:43.496117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.511009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e5e1-e81b-4022-9878-5c693aeb77e9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.518296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.519214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.519541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.520133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.521558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:43.522146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.523924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.541394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 905/1849] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:43.546425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.557254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa628d4-1392-4011-9dda-5fa4c3380f0b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.563191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.564139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.564635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.565547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.566452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.568740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.582871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:43.606494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 945/1850] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:43 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:43.610832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.624207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de378-c3dd-4acf-9ba2-4519befbaf5c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.709301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.709687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.710218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.710218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.710930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.713083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.734157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:43.748607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.753012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 906/1851] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:43 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:43.769842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4e47-3a97-47c7-a81c-fa54092864aa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.776179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.778088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.779219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.779511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.780305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.781962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.795900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 946/1852] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:43.799775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.819204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207fbb-7357-4221-b165-357776fc3719 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.840353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.841878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.842882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.843352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.844329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.847072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.874172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 907/1853] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:38:43.878625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.889091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:43.891016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:43.897652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ec75-0f63-4b9a-95f5-90d116ce38d2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.904818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad09ffb-a88a-43b4-8b4d-f0ce416dd211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.905773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad09ffb-a88a-43b4-8b4d-f0ce416dd211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.906202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad09ffb-a88a-43b4-8b4d-f0ce416dd211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.906642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad09ffb-a88a-43b4-8b4d-f0ce416dd211 admin admin] PATH_INFO: `/v3/projects/b0630a812a8e4ef488096ee1de298180/users/825c27d89450493d95cf480b0a97e12c/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.916185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5ea3-0032-44bb-9478-236c2105d6e7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:43.924497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:43.925591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.925878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.926162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] PATH_INFO: `/v3/projects/b3942dd3a0f84e2ca50b18a5971a331a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:43.927454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3942dd3a0f84e2ca50b18a5971a331a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.929778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.933140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad09ffb-a88a-43b4-8b4d-f0ce416dd211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0630a812a8e4ef488096ee1de298180, user_id=825c27d89450493d95cf480b0a97e12c, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:43.936777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad09ffb-a88a-43b4-8b4d-f0ce416dd211 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:43.960915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 947/1854] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:43 2022] PUT /identity/v3/projects/b0630a812a8e4ef488096ee1de298180/users/825c27d89450493d95cf480b0a97e12c/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:43.965907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:43.966820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:43.968184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:44.004873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3942dd3a0f84e2ca50b18a5971a331a', 'request_id': 'req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.013567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3942dd3a0f84e2ca50b18a5971a331a', 'request_id': 'req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.013797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] MFA Rules not processed for user `825c27d89450493d95cf480b0a97e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:44.015181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:44.020514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3942dd3a0f84e2ca50b18a5971a331a', 'request_id': 'req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.037618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] The token cache is being invalidate because project b3942dd3a0f84e2ca50b18a5971a331a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:44.037917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.038972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.040968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 908/1855] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:43 2022] DELETE /identity/v3/projects/b3942dd3a0f84e2ca50b18a5971a331a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:44.045699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:44.047569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:44.113887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 948/1856] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:44.130297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:44.133121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:44.141194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151ce5-5f3c-4118-b9fd-a7936bff9fa7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:44.146874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:44.151290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:44.151978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:44.152558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] PATH_INFO: `/v3/users/8ecd32ff659d4a51b770c9d5f4813030` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:44.154223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecd32ff659d4a51b770c9d5f4813030)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:44.157067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:44.205989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2767f-9658-4ad6-a922-c5f1b09e651e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:44.212345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:44.213097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:44.213393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:44.213804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:44.219340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecd32ff659d4a51b770c9d5f4813030'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.222762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:44.224261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:44.233925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecd32ff659d4a51b770c9d5f4813030'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.234370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 949/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:44.243318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecd32ff659d4a51b770c9d5f4813030'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.248469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecd32ff659d4a51b770c9d5f4813030'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.250007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-07ccbcd1-6d95-43b0-9a16-370a0f815a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecd32ff659d4a51b770c9d5f4813030'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.251759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:44.282002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 909/1858] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:44 2022] DELETE /identity/v3/users/8ecd32ff659d4a51b770c9d5f4813030 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:44.796651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:44.819745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60478-33c9-4a70-a533-44e4db1b1987 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:44.873714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:44.887051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:44.888016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:44.888307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:44.888586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] PATH_INFO: `/v3/projects/c4bd40518de141649dc42f0ce311881b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:44.889781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bd40518de141649dc42f0ce311881b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:44.891729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:44.939133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bd40518de141649dc42f0ce311881b', 'request_id': 'req-8cc94f92-6593-4469-91a7-40a70171c071'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.958977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bd40518de141649dc42f0ce311881b', 'request_id': 'req-8cc94f92-6593-4469-91a7-40a70171c071'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.958977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bd40518de141649dc42f0ce311881b', 'request_id': 'req-8cc94f92-6593-4469-91a7-40a70171c071'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:44.999417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] The token cache is being invalidate because project c4bd40518de141649dc42f0ce311881b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:44.999764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:45.000422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8cc94f92-6593-4469-91a7-40a70171c071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:45.009468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.010002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.010002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.016175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 950/1859] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:44 2022] DELETE /identity/v3/projects/c4bd40518de141649dc42f0ce311881b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:45.046946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:45.046946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:45.112565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 910/1860] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:45.121952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.122320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.122606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.141262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:45.142434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:45.150194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 951/1861] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:45.154889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.167403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb80c5-0123-4435-825c-654c51dcc0df None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.172192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.172853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.173145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.173424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.174199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:45.174511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.176167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.188247 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 911/1862] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:45.192637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.202509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1b825-e37b-4b25-b672-ce666d443fb0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.207142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.207789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.208106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.208386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.209085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.211003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.235791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 952/1863] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:45.239882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.250254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3822f-66e2-49c9-8f9f-7edacc289555 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.305827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.306483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.306741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.307052 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.307761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.310390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.331626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 912/1864] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:45.335667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.346029 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b96e1-c1d7-46a0-83b5-005697fcd789 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.350884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.351556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.351857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.352166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.352912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.354539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.368337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 953/1865] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:45.369551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.380985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4073d-2da6-418c-afb5-99aeb1a11645 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.385914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d666-8280-49e0-a920-71427ea8c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.386578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d666-8280-49e0-a920-71427ea8c507 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.386873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d666-8280-49e0-a920-71427ea8c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.387155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d666-8280-49e0-a920-71427ea8c507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.388551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6d666-8280-49e0-a920-71427ea8c507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.390160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6d666-8280-49e0-a920-71427ea8c507 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.400226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 913/1866] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:45.404725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.414581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba43294-70ee-4bda-b154-aaa8f6001e0d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.419626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.420562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.420850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.421130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] PATH_INFO: `/v3/projects/74089135abdd444e8a5ab41dc1241ca3/users/4530cb25427c4a0abf66a43ded99d629/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.435850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74089135abdd444e8a5ab41dc1241ca3, user_id=4530cb25427c4a0abf66a43ded99d629, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.438577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.452062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 954/1867] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:45 2022] PUT /identity/v3/projects/74089135abdd444e8a5ab41dc1241ca3/users/4530cb25427c4a0abf66a43ded99d629/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:38:45.463322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.463619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.463926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.489901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] MFA Rules not processed for user `4530cb25427c4a0abf66a43ded99d629`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:45.491221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:45.539108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:45.563026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 914/1868] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:45.567405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.647729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493af48-e1bb-4d17-a537-99aa6e9a4d78 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.659407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.659407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.659407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.659407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.659807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.659807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.679480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:45.687622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 955/1869] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:45.691448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.704457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e43c-f361-4ca3-9b81-d476bd8d0ab0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.760138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.760812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.761100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.761388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.762083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.765041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.786693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 915/1870] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:45 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:45.791005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.801647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8acdcf-0676-4c18-89c2-11be20bb4af8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.806829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.807517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.807912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.808322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.809199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.810940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.826892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 956/1871] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:45.827563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.838140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74277-435f-455e-952e-7394d8f55350 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:45.844083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:45.845122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:45.845416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:45.845696 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] PATH_INFO: `/v3/projects/17a79d6ccc7c474185fb2313c89e7fd6/users/ce8c75db5a97439694b048f999093809/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:45.864657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a79d6ccc7c474185fb2313c89e7fd6, user_id=ce8c75db5a97439694b048f999093809, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:45.867369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:45.884999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 916/1872] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:45 2022] PUT /identity/v3/projects/17a79d6ccc7c474185fb2313c89e7fd6/users/ce8c75db5a97439694b048f999093809/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:38:45.889767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:45.902544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa419-c01f-4e71-b0c4-2bf69de94b31 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:46.001399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3de39-7134-44b1-87ed-fe19b9605a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:46.002667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3de39-7134-44b1-87ed-fe19b9605a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:46.002667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3de39-7134-44b1-87ed-fe19b9605a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:46.002902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3de39-7134-44b1-87ed-fe19b9605a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:46.003607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3de39-7134-44b1-87ed-fe19b9605a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:46.005269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3de39-7134-44b1-87ed-fe19b9605a17 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:46.017331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 957/1873] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:46.021178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:46.035859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dc7bb-fcb6-4aa8-83a2-9f5d383ec310 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:46.048453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:46.050179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:46.050617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:46.050888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] PATH_INFO: `/v3/projects/17a79d6ccc7c474185fb2313c89e7fd6/users/ce8c75db5a97439694b048f999093809/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:46.053422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a79d6ccc7c474185fb2313c89e7fd6, user_id=ce8c75db5a97439694b048f999093809, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:46.056146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:46.074003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 917/1874] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:46 2022] PUT /identity/v3/projects/17a79d6ccc7c474185fb2313c89e7fd6/users/ce8c75db5a97439694b048f999093809/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:46.084739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:46.084984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:46.085376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:46.117998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] MFA Rules not processed for user `ce8c75db5a97439694b048f999093809`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:46.119220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:46.192311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 958/1875] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:46.203376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:46.205207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:46.263148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b83d-fde3-4456-ba6c-000dd953b96f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:46.266982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:46.267755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:46.268082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:46.268479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:46.279312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:46.280761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:46.290345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 918/1876] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:46.339920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:46.341393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:46.353301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd927-1e37-4b1b-8452-f7db1d9c2b7d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:46.357754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8d18f-f8b1-4193-aa34-2667a582774f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:46.358380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8d18f-f8b1-4193-aa34-2667a582774f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:46.358665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8d18f-f8b1-4193-aa34-2667a582774f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:46.358939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8d18f-f8b1-4193-aa34-2667a582774f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:46.423254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8d18f-f8b1-4193-aa34-2667a582774f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:46.424745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8d18f-f8b1-4193-aa34-2667a582774f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:46.433656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 959/1877] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:49.061000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:49.063107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:49.150951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:49.199654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9d13-63fa-41ac-b901-858b702ea790 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:49.208153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:49.209358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:49.209737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:49.210107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] PATH_INFO: `/v3/users/825c27d89450493d95cf480b0a97e12c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:49.211456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=825c27d89450493d95cf480b0a97e12c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:49.214042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:49.284071 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825c27d89450493d95cf480b0a97e12c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:49.302153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825c27d89450493d95cf480b0a97e12c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:49.312912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825c27d89450493d95cf480b0a97e12c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:49.314188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825c27d89450493d95cf480b0a97e12c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:49.316681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825c27d89450493d95cf480b0a97e12c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:49.345369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 919/1878] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:49 2022] DELETE /identity/v3/users/825c27d89450493d95cf480b0a97e12c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:49.348488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:49.348987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:49.348987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:49.382131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:49.388230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:49.399760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:49.527699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 960/1879] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:49.554843 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:49.556895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:49.626309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaef35-16f1-419a-a863-dacd4bdee68a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:49.629936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f26c9-3398-44ad-89dc-efe23da41564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:49.630584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f26c9-3398-44ad-89dc-efe23da41564 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:49.630869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f26c9-3398-44ad-89dc-efe23da41564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:49.631147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f26c9-3398-44ad-89dc-efe23da41564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:49.641127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f26c9-3398-44ad-89dc-efe23da41564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:49.642566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f26c9-3398-44ad-89dc-efe23da41564 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:49.653961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 920/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:49.970463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:49.972569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:49.992504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150a5f-9ccf-436a-bdab-4af484f6107d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:49.997965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:49.999012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:49.999469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:49.999826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] PATH_INFO: `/v3/projects/b0630a812a8e4ef488096ee1de298180` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.001147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0630a812a8e4ef488096ee1de298180)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.003334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.051335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0630a812a8e4ef488096ee1de298180', 'request_id': 'req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:50.057524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0630a812a8e4ef488096ee1de298180', 'request_id': 'req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:50.063380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0630a812a8e4ef488096ee1de298180', 'request_id': 'req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:50.077251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] The token cache is being invalidate because project b0630a812a8e4ef488096ee1de298180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:50.077539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:50.078151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2bf5c39e-daf9-49c8-a51a-b9a07b57de24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:50.079673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 961/1881] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:49 2022] DELETE /identity/v3/projects/b0630a812a8e4ef488096ee1de298180 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:50.084571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.085021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.085153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.103544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:50.104742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:50.165732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 921/1882] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:50.173712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.174009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.174294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.193104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:50.194313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:50.203332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 962/1883] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:50.208136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.213174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:50.219902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad9d23-d78f-450d-ac3a-c629f9681949 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.226054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.226826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.227112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.227389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.228150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:50.228492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.230098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.248917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 922/1884] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:50.253276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.263950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac875262-b308-4eb4-81ab-e944f9fa14ce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.268638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.269289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.269578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.269854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.270537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.272506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.298608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 963/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:50 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:50.302762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.312737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bc3f-d86b-4391-9d53-7dd622afa3c8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.366795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.367447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.367732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.368041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.368722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.370636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.393878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 923/1886] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:50 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:38:50.395035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.409055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858a4e-8544-4bec-87aa-0362e70678d5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.413754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.414423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.414717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.415000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.416468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.418092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.428915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 964/1887] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:50.432898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.443478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60da11-6112-426f-a29f-db6cb4dddf24 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.448158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ffd0-0732-4344-b05b-215201a6cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.448824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ffd0-0732-4344-b05b-215201a6cd27 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.449113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ffd0-0732-4344-b05b-215201a6cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.449393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ffd0-0732-4344-b05b-215201a6cd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.450951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ffd0-0732-4344-b05b-215201a6cd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.452731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ffd0-0732-4344-b05b-215201a6cd27 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.463129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 924/1888] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:50.467417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.477306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debb1a3-6bc7-42c3-87ac-8db315063f65 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.482096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.482995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.483284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.483570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] PATH_INFO: `/v3/projects/1f27e44dedee4233a4fa5a6cac73ae97/users/53249c6465d14f5b8aa033cf966098f7/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.499044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f27e44dedee4233a4fa5a6cac73ae97, user_id=53249c6465d14f5b8aa033cf966098f7, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.501805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.517261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 965/1889] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:50 2022] PUT /identity/v3/projects/1f27e44dedee4233a4fa5a6cac73ae97/users/53249c6465d14f5b8aa033cf966098f7/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:50.530150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.530564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.530849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.570752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] MFA Rules not processed for user `53249c6465d14f5b8aa033cf966098f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:50.571910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:50.647269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 925/1890] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:50.660024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:50.662153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:50.696607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:50.732461 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445637c-4403-4060-ac75-c486337d6eb9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:50.739366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c2355-3429-49d0-bfdc-393efa17236d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:50.740137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c2355-3429-49d0-bfdc-393efa17236d service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:50.740424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c2355-3429-49d0-bfdc-393efa17236d service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:50.740703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c2355-3429-49d0-bfdc-393efa17236d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:50.759994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c2355-3429-49d0-bfdc-393efa17236d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:50.761454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c2355-3429-49d0-bfdc-393efa17236d service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:50.771359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 966/1891] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:55.450272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:55.457012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:55.540465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:55.549584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152f751-d81d-4010-98e0-52a25351c8d5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:55.555807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:55.556880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:55.557237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:55.557580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] PATH_INFO: `/v3/users/4530cb25427c4a0abf66a43ded99d629` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:55.558894 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4530cb25427c4a0abf66a43ded99d629)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:55.561743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:55.615992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4530cb25427c4a0abf66a43ded99d629'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:55.636951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4530cb25427c4a0abf66a43ded99d629'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:55.648133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4530cb25427c4a0abf66a43ded99d629'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:55.649012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4530cb25427c4a0abf66a43ded99d629'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:55.649762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4530cb25427c4a0abf66a43ded99d629'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:55.665735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 926/1892] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:55 2022] DELETE /identity/v3/users/4530cb25427c4a0abf66a43ded99d629 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:55.670323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:55.670818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:55.670903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:55.702949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:55.704285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:55.772817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 967/1893] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:55.783529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:55.785076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:55.857097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955edc7-f417-409e-a408-800eba7892d1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:55.860841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae82f8-e46b-4e04-b4dc-cf93e50a6fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:55.861512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae82f8-e46b-4e04-b4dc-cf93e50a6fda service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:55.861793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae82f8-e46b-4e04-b4dc-cf93e50a6fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:55.862076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae82f8-e46b-4e04-b4dc-cf93e50a6fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:55.871507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae82f8-e46b-4e04-b4dc-cf93e50a6fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:55.873729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae82f8-e46b-4e04-b4dc-cf93e50a6fda service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:55.883607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 927/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:56.180521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:56.181979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:56.199636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f522-9d06-46f2-bb35-7b919d502133 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:56.205246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:56.206131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:56.206465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:56.206691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] PATH_INFO: `/v3/projects/74089135abdd444e8a5ab41dc1241ca3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:56.207932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=74089135abdd444e8a5ab41dc1241ca3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:56.209987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:56.259068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba3e8-3f7f-4990-bfc3-e574bf2fc814 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:56.259362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba3e8-3f7f-4990-bfc3-e574bf2fc814 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:56.259641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba3e8-3f7f-4990-bfc3-e574bf2fc814 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:56.261865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 928/1895] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:38:56.283793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:56.284023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74089135abdd444e8a5ab41dc1241ca3', 'request_id': 'req-0774e27f-4d63-4098-9b7b-173e8215b5fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.284117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:56.284334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:56.296838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74089135abdd444e8a5ab41dc1241ca3', 'request_id': 'req-0774e27f-4d63-4098-9b7b-173e8215b5fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.310670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74089135abdd444e8a5ab41dc1241ca3', 'request_id': 'req-0774e27f-4d63-4098-9b7b-173e8215b5fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.320980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:56.328982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:56.340084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] The token cache is being invalidate because project 74089135abdd444e8a5ab41dc1241ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:56.341026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.341817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.346602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 968/1896] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:56 2022] DELETE /identity/v3/projects/74089135abdd444e8a5ab41dc1241ca3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:56.348809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:56.350345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:56.477686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:56.502879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e27f-4d63-4098-9b7b-173e8215b5fb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:56.518408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:56.518408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:56.521899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:56.522196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] PATH_INFO: `/v3/users/ce8c75db5a97439694b048f999093809` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:56.526344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8c75db5a97439694b048f999093809)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:56.531039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:56.538983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 929/1897] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:38:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:38:56.619289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8c75db5a97439694b048f999093809'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.638832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8c75db5a97439694b048f999093809'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.649844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8c75db5a97439694b048f999093809'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.652235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8c75db5a97439694b048f999093809'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.667735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8c75db5a97439694b048f999093809'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:56.677298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 969/1898] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:56 2022] DELETE /identity/v3/users/ce8c75db5a97439694b048f999093809 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:56.742161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:56.744167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:56.769937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b40e-c868-4bba-a9cb-c28797b9e4b1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:56.800022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:56.927440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:56.928424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:56.928956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:56.933866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:56.945563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:56.980087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:56.988133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fdcf2-0b7d-40ba-bbf0-87e9524bdbcf service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:57.032625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 930/1899] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:57.990291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:57.991904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:58.065186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dba30-72a6-4103-b799-cbe2ad7ad661 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.069696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.070555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.070837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.071114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] PATH_INFO: `/v3/projects/17a79d6ccc7c474185fb2313c89e7fd6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.072308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a79d6ccc7c474185fb2313c89e7fd6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.074453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.123246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a79d6ccc7c474185fb2313c89e7fd6', 'request_id': 'req-d245ef2d-da33-4eaf-bca7-344aed33720e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:58.129613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a79d6ccc7c474185fb2313c89e7fd6', 'request_id': 'req-d245ef2d-da33-4eaf-bca7-344aed33720e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:58.135615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a79d6ccc7c474185fb2313c89e7fd6', 'request_id': 'req-d245ef2d-da33-4eaf-bca7-344aed33720e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:58.149813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] The token cache is being invalidate because project 17a79d6ccc7c474185fb2313c89e7fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:38:58.150168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:58.150820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d245ef2d-da33-4eaf-bca7-344aed33720e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:38:58.152632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 970/1900] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:38:57 2022] DELETE /identity/v3/projects/17a79d6ccc7c474185fb2313c89e7fd6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:58.158117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.158608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.158709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.177656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:58.178885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:58.239428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 931/1901] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:58.247124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.247419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.247701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.256145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:58.270062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:58.271267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:58.279365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 971/1902] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:58.283927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.293728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b823c6-834a-49e1-b9a5-b00a4dfe39ba None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.301183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.301850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.302135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.302411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.303151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:38:58.303459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.305121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.317189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 932/1903] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:38:58.321981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.332539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9896e7-65c4-48aa-8f40-730ff382ccb2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.341562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.342881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.343957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.344308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.344944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.346904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.373818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 972/1904] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:58.377807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.388304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a450b1-df60-44f5-b8a9-d9c774304ee2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.448423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.449096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.449385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.449666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.450369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.452932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.474813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 933/1905] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:58.478964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.489307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d867c-8258-496f-baba-87480211eb68 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.493888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.494538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.494821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.495099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.495821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.497449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.510707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 973/1906] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:58.512396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.523421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a812a58-172b-4e71-a2c4-7b919a903232 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.528887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2b7d-b5b8-4e32-ab21-f765ddaa8a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.529570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2b7d-b5b8-4e32-ab21-f765ddaa8a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.530415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2b7d-b5b8-4e32-ab21-f765ddaa8a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.530697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2b7d-b5b8-4e32-ab21-f765ddaa8a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.531428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2b7d-b5b8-4e32-ab21-f765ddaa8a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.533187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2b7d-b5b8-4e32-ab21-f765ddaa8a94 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.543174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 934/1907] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:58.547404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.557950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d3f1-1928-4704-8b4b-12ed0cf18e17 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.563247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.564164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.564446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.564714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] PATH_INFO: `/v3/projects/6aaac74816a0413fac3650e313725185/users/738d4453519449ccbc668847770960f1/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.581043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaac74816a0413fac3650e313725185, user_id=738d4453519449ccbc668847770960f1, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.583728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.599124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 974/1908] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:58 2022] PUT /identity/v3/projects/6aaac74816a0413fac3650e313725185/users/738d4453519449ccbc668847770960f1/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:58.609572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.609864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.610150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.616669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:58.646578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] MFA Rules not processed for user `738d4453519449ccbc668847770960f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:58.647792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:58.725899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 935/1909] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:58.730319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.802056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43354-bfc8-4f0b-b8e1-551b3eb03da1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.806850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.807520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.807853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.808150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.808851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.810836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.837997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 975/1910] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:58.842003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.852983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b48e3f-6e04-4ee3-8b8f-1be55ea9c354 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.910747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.911489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.911772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.912081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.912787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.914723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.935792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 936/1911] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:38:58 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:38:58.940409 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.950784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344fd01-2c0d-4d2c-8dbc-635ed7e7530e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.955511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.956199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.956485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.956785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:58.957508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:58.959149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:58.970051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 976/1912] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:58.973896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:58.984392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127f1f-ac70-4090-835a-126fdb257b11 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:58.989198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:58.990216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:58.990506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:58.990836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] PATH_INFO: `/v3/projects/2dd1c21e113e4249a2ca3ae2d3315a7a/users/9a62b17ff5de4d2782a74668ecba044d/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:59.005955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd1c21e113e4249a2ca3ae2d3315a7a, user_id=9a62b17ff5de4d2782a74668ecba044d, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:59.009181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:59.023398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 937/1913] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:58 2022] PUT /identity/v3/projects/2dd1c21e113e4249a2ca3ae2d3315a7a/users/9a62b17ff5de4d2782a74668ecba044d/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:38:59.027311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:59.038272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dd3cb-35b7-424d-9aed-a0d61b4f5532 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:59.106361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109587-0a58-4b07-9d54-1722f1ee1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:59.107038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109587-0a58-4b07-9d54-1722f1ee1609 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:59.107333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109587-0a58-4b07-9d54-1722f1ee1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:59.107612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109587-0a58-4b07-9d54-1722f1ee1609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:59.109105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109587-0a58-4b07-9d54-1722f1ee1609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:59.111301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109587-0a58-4b07-9d54-1722f1ee1609 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:59.123888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 977/1914] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:38:59.126376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:59.139342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd068-15a4-410d-b02c-241e0ea5bcc3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:59.144672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:59.145508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:59.145795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:59.146075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] PATH_INFO: `/v3/projects/2dd1c21e113e4249a2ca3ae2d3315a7a/users/9a62b17ff5de4d2782a74668ecba044d/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:59.148115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd1c21e113e4249a2ca3ae2d3315a7a, user_id=9a62b17ff5de4d2782a74668ecba044d, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:59.150850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:59.163332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 938/1915] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:38:59 2022] PUT /identity/v3/projects/2dd1c21e113e4249a2ca3ae2d3315a7a/users/9a62b17ff5de4d2782a74668ecba044d/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:38:59.174524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:59.174815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:59.175092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:59.194410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:59.204640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] MFA Rules not processed for user `9a62b17ff5de4d2782a74668ecba044d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:38:59.206235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:59.275334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 978/1916] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:38:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:38:59.286848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:38:59.288561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:38:59.334090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:59.345524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a43d5-8e75-49b6-91ac-ff313dade98e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:38:59.349127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34b012-c4d4-4753-a0d9-c6e4d7415363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:38:59.349759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34b012-c4d4-4753-a0d9-c6e4d7415363 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:38:59.350043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34b012-c4d4-4753-a0d9-c6e4d7415363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:38:59.350319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34b012-c4d4-4753-a0d9-c6e4d7415363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:38:59.359966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34b012-c4d4-4753-a0d9-c6e4d7415363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:38:59.361397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34b012-c4d4-4753-a0d9-c6e4d7415363 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:38:59.370592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 939/1917] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:38:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:38:59.979855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:00.050333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac52844-4c1c-4171-9d6d-626c81298b10 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:00.054957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:00.055882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:00.056169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:00.056447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] PATH_INFO: `/v3/users/738d4453519449ccbc668847770960f1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:00.057709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] RBAC: Authorizing `identity:delete_user(user_id=738d4453519449ccbc668847770960f1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:00.059705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:00.113057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738d4453519449ccbc668847770960f1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.125737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738d4453519449ccbc668847770960f1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.133187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738d4453519449ccbc668847770960f1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.133837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738d4453519449ccbc668847770960f1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.141748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738d4453519449ccbc668847770960f1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.147703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 979/1918] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:38:59 2022] DELETE /identity/v3/users/738d4453519449ccbc668847770960f1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:00.152109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:00.152458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:00.152846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:00.171693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:00.173603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:00.235636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 940/1919] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:00.245849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:00.247244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:00.267035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:00.321751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439d81-1d6d-4c92-ba47-ddc3e83252db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:00.324337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:00.324993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:00.325282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:00.325563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:00.335375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:00.336858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:00.348666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 980/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:00.661361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:00.662767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:00.677049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f75ae-fd4b-4e65-a74d-65d581dd2550 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:00.681667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:00.682608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:00.682961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:00.683307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] PATH_INFO: `/v3/projects/6aaac74816a0413fac3650e313725185` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:00.684592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aaac74816a0413fac3650e313725185)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:00.687314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:00.757099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aaac74816a0413fac3650e313725185', 'request_id': 'req-9f82ad68-7d8d-4708-8f25-1ef4332ca711'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.771080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aaac74816a0413fac3650e313725185', 'request_id': 'req-9f82ad68-7d8d-4708-8f25-1ef4332ca711'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.784557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aaac74816a0413fac3650e313725185', 'request_id': 'req-9f82ad68-7d8d-4708-8f25-1ef4332ca711'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.804763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] The token cache is being invalidate because project 6aaac74816a0413fac3650e313725185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:00.805172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.806000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.807583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 941/1921] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:00 2022] DELETE /identity/v3/projects/6aaac74816a0413fac3650e313725185 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:00.812475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:00.822762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d47b7b-1d6d-4c57-a46e-34149a23aa02 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:00.878498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:00.879372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:00.879651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:00.880027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] PATH_INFO: `/v3/users/9a62b17ff5de4d2782a74668ecba044d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:00.881207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a62b17ff5de4d2782a74668ecba044d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:00.883397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:00.930638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a62b17ff5de4d2782a74668ecba044d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.943935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a62b17ff5de4d2782a74668ecba044d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.953197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a62b17ff5de4d2782a74668ecba044d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.955886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a62b17ff5de4d2782a74668ecba044d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.962048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e8acdea3-0a27-42d4-824d-6e2cd21673bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a62b17ff5de4d2782a74668ecba044d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:00.968401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 981/1922] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:00 2022] DELETE /identity/v3/users/9a62b17ff5de4d2782a74668ecba044d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:01.268321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.271415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:01.287328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ad68-7d8d-4708-8f25-1ef4332ca711 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.345923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.346847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.347131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.347415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] PATH_INFO: `/v3/projects/2dd1c21e113e4249a2ca3ae2d3315a7a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.348671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd1c21e113e4249a2ca3ae2d3315a7a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.350604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.362790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:01.406543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd1c21e113e4249a2ca3ae2d3315a7a', 'request_id': 'req-55a9cb78-7826-4360-bb02-ea82ea5a53bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:01.412814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd1c21e113e4249a2ca3ae2d3315a7a', 'request_id': 'req-55a9cb78-7826-4360-bb02-ea82ea5a53bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:01.418898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd1c21e113e4249a2ca3ae2d3315a7a', 'request_id': 'req-55a9cb78-7826-4360-bb02-ea82ea5a53bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:01.432602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] The token cache is being invalidate because project 2dd1c21e113e4249a2ca3ae2d3315a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:01.432897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:01.433544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-55a9cb78-7826-4360-bb02-ea82ea5a53bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:01.435117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 942/1923] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:01 2022] DELETE /identity/v3/projects/2dd1c21e113e4249a2ca3ae2d3315a7a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:01.440602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.441091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.441183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.460943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:01.462770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:01.504851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:01.535810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 982/1924] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:01.543500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.543794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.544100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.564518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:01.565804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:01.573971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 943/1925] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:01.578500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.589532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43128f-a2dc-4b96-ae25-96c8f38a8ea0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.594715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.595382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.595699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.596015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.596758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:01.597077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.598711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.615229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 983/1926] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:39:01.616372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.626524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d83a3-cb6d-41b4-a75f-315e859f4661 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.631246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.631948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.632262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.632542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.633500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.635431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.661903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 944/1927] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:01 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:01.665986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.676741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74059-1efa-46ee-ac11-aa355e0d7af5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.732621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.733825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.734354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.734644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.735332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.737306 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.758459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 984/1928] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:01 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:01.762525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.773086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2de76-30bd-4be6-afce-c60462cebc2d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.777766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.778424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.778706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.778980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.779711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.782009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.796387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 945/1929] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:01.797826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.808475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476ba4a-8738-4b18-b0cb-52f52031c220 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.814345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091d648-d6aa-4402-ab4d-4b8e605ef753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.815134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d648-d6aa-4402-ab4d-4b8e605ef753 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.815418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d648-d6aa-4402-ab4d-4b8e605ef753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.815775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d648-d6aa-4402-ab4d-4b8e605ef753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.816460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091d648-d6aa-4402-ab4d-4b8e605ef753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.818090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091d648-d6aa-4402-ab4d-4b8e605ef753 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.833907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 985/1930] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:01.838462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:01.848998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444208b1-15b2-4914-a3a2-b4596d9693da admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:01.853755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:01.854632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.854917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.855193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] PATH_INFO: `/v3/projects/1cd2c391104f446e8b85f22db7b0ddd0/users/dd51883e54e0483ba911a9910b3327d1/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.870722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2c391104f446e8b85f22db7b0ddd0, user_id=dd51883e54e0483ba911a9910b3327d1, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:01.873581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:01.887341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 946/1931] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:01 2022] PUT /identity/v3/projects/1cd2c391104f446e8b85f22db7b0ddd0/users/dd51883e54e0483ba911a9910b3327d1/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:01.897558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:01.897875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:01.898156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:01.927199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] MFA Rules not processed for user `dd51883e54e0483ba911a9910b3327d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:01.928505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:01.993090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 986/1932] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:02.005744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:02.007447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:02.065278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea527-49b8-424b-b7ed-4da3e13b9497 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:02.068881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc849e-aa9e-4bd5-9b45-fea1067922c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:02.069519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc849e-aa9e-4bd5-9b45-fea1067922c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:02.069804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc849e-aa9e-4bd5-9b45-fea1067922c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:02.070082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc849e-aa9e-4bd5-9b45-fea1067922c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:02.078946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc849e-aa9e-4bd5-9b45-fea1067922c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:02.080420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc849e-aa9e-4bd5-9b45-fea1067922c3 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:02.092296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 947/1933] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:02.113145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:02.149673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:02.182776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849391-3e87-4d22-a171-6d42bbfb25f9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:02.187908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:02.188813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:02.189092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:02.189364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] PATH_INFO: `/v3/users/dd51883e54e0483ba911a9910b3327d1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:02.190570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd51883e54e0483ba911a9910b3327d1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:02.192561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:02.242997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd51883e54e0483ba911a9910b3327d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.256641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd51883e54e0483ba911a9910b3327d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.267957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd51883e54e0483ba911a9910b3327d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.268566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd51883e54e0483ba911a9910b3327d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.276009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd51883e54e0483ba911a9910b3327d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.282167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 987/1934] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:02 2022] DELETE /identity/v3/users/dd51883e54e0483ba911a9910b3327d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:02.286733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:02.287301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:02.287301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:02.304903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:02.306157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:02.345731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:02.375476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 948/1935] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:39:02.402380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:02.403944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:02.465118 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb539-a106-44eb-add3-483703abe17e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:02.470075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6487b7-8a35-42ce-98ca-a0a476ff3713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:02.473890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6487b7-8a35-42ce-98ca-a0a476ff3713 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:02.473890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6487b7-8a35-42ce-98ca-a0a476ff3713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:02.473890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6487b7-8a35-42ce-98ca-a0a476ff3713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:02.481354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6487b7-8a35-42ce-98ca-a0a476ff3713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:02.482805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6487b7-8a35-42ce-98ca-a0a476ff3713 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:02.493790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 988/1936] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:02.872163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:02.874161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:02.888318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72fb4f-950b-45c3-bb88-b49c266bc465 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:02.894055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:02.894927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:02.895344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:02.895621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] PATH_INFO: `/v3/projects/1cd2c391104f446e8b85f22db7b0ddd0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:02.896870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd2c391104f446e8b85f22db7b0ddd0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:02.898795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:02.946344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd2c391104f446e8b85f22db7b0ddd0', 'request_id': 'req-628e33df-5c9b-477d-984f-9f4498220608'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.952988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd2c391104f446e8b85f22db7b0ddd0', 'request_id': 'req-628e33df-5c9b-477d-984f-9f4498220608'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.958705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd2c391104f446e8b85f22db7b0ddd0', 'request_id': 'req-628e33df-5c9b-477d-984f-9f4498220608'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.971858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] The token cache is being invalidate because project 1cd2c391104f446e8b85f22db7b0ddd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:02.972153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.972806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-628e33df-5c9b-477d-984f-9f4498220608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:02.974398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 949/1937] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:02 2022] DELETE /identity/v3/projects/1cd2c391104f446e8b85f22db7b0ddd0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:02.979487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:02.979780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:02.980107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:02.999528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:03.000791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:03.049504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:03.064355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 989/1938] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:03.073089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.073381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.073660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.092238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:03.094400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:03.102251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 950/1939] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:03.106310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.116257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649c1b-610c-4bf5-ae91-114c836aa74a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.120881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.121535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.121824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.122106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.122841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:03.123156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.124926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.136775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 990/1940] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:39:03.141466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.150610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6d81-4fbd-4e53-8162-e159ca8fcb56 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.156061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.156760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.157047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.157320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.158021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.159959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.184782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 951/1941] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:03 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:03.189525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.199309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7d026-a7dc-44fa-8d3d-1a9e849a5090 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.257098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.258026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.258313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.258590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.259302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.261389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.286013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 991/1942] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:03 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:03.289994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.302514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411f18-e353-4e8e-80e9-3966af17f509 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.307137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.307803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.308113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.308390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.309135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.310703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.323183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 952/1943] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:03.328338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.338087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bab11-9428-4e84-8ea0-869529de5dcb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.343021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29209496-3247-43e9-bccf-14c19069c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.343692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29209496-3247-43e9-bccf-14c19069c4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.344007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29209496-3247-43e9-bccf-14c19069c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.344289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29209496-3247-43e9-bccf-14c19069c4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.345022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29209496-3247-43e9-bccf-14c19069c4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.346636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29209496-3247-43e9-bccf-14c19069c4b1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.359764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 992/1944] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:03.360973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.370737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bddea8-4094-4ce6-a0fd-1ec7495e7af7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.376179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.377059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.377374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.377618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] PATH_INFO: `/v3/projects/ffb5e6607fb843bca3fb4a6ae694d47e/users/e671d76c5e5b4d528310abedb603d16d/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.393420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb5e6607fb843bca3fb4a6ae694d47e, user_id=e671d76c5e5b4d528310abedb603d16d, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.398032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.413042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 953/1945] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:03 2022] PUT /identity/v3/projects/ffb5e6607fb843bca3fb4a6ae694d47e/users/e671d76c5e5b4d528310abedb603d16d/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:03.418017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5afb33-e543-40d6-b563-7709d494ff5e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.418314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5afb33-e543-40d6-b563-7709d494ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.418597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5afb33-e543-40d6-b563-7709d494ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.437137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9d5afb33-e543-40d6-b563-7709d494ff5e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:03.438445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d5afb33-e543-40d6-b563-7709d494ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:03.498040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 993/1946] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:03.508164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:03.509951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:03.573991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3df93-5abe-47d8-bc4d-36b9dfeaa280 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:03.578053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:03.578692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:03.579088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:03.579371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:03.588409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:03.589864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:03.599689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 954/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:04.352723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507042-9810-4198-80b0-1c532829d9fe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:04.353043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507042-9810-4198-80b0-1c532829d9fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:04.353326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507042-9810-4198-80b0-1c532829d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:04.384040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-84507042-9810-4198-80b0-1c532829d9fe None None] MFA Rules not processed for user `e671d76c5e5b4d528310abedb603d16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:04.385552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-84507042-9810-4198-80b0-1c532829d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:04.440311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:04.459624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 994/1948] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:04.471731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:04.473190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:04.478703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:04.539127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e896-5023-4b64-af67-818a634b4971 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:04.543339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:04.544204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:04.544487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:04.544922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:04.554738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:04.556386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:04.578255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 955/1949] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:13.321983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725f370-6077-461d-bf36-66bff88a121c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:13.322645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725f370-6077-461d-bf36-66bff88a121c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:13.323468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725f370-6077-461d-bf36-66bff88a121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:13.342772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2725f370-6077-461d-bf36-66bff88a121c None None] MFA Rules not processed for user `e671d76c5e5b4d528310abedb603d16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:13.344883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2725f370-6077-461d-bf36-66bff88a121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:13.360385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 995/1950] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:13.402746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:13.404432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:13.426099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a248ee1-6a81-4ea2-aecb-1ee3e69cbeff service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:13.433040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:13.434950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:13.435340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:13.435684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] PATH_INFO: `/v3/users/9f0015c46e8c4d6aa54a4ad56a94c452` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:13.437753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0015c46e8c4d6aa54a4ad56a94c452)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:13.439884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:13.515769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0015c46e8c4d6aa54a4ad56a94c452'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:13.530565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0015c46e8c4d6aa54a4ad56a94c452'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:13.540840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0015c46e8c4d6aa54a4ad56a94c452'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:13.541863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0015c46e8c4d6aa54a4ad56a94c452'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:13.542747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0015c46e8c4d6aa54a4ad56a94c452'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:13.560251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 956/1951] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:13 2022] DELETE /identity/v3/users/9f0015c46e8c4d6aa54a4ad56a94c452 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:13.566219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:13.566900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:13.567383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:13.588394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:13.589658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:13.663866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 996/1952] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:13.685235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:13.688586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:13.793848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aeba2-b2e9-485b-b692-371e2210f5fe admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:13.801296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:13.802443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:13.803191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:13.803954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:13.823882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:13.825803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:13.842776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 957/1953] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:14.375219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:14.377326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:14.403494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a32d4-6e0b-4065-a118-fdfb89148636 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:14.410566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:14.413210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:14.413855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:14.414421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] PATH_INFO: `/v3/projects/4bde6b7ca48445638a8e6e302edb3923` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:14.417971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bde6b7ca48445638a8e6e302edb3923)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:14.420640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:14.493091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bde6b7ca48445638a8e6e302edb3923', 'request_id': 'req-5b82a82a-8580-4d4a-85dd-9329accefcb8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.502317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bde6b7ca48445638a8e6e302edb3923', 'request_id': 'req-5b82a82a-8580-4d4a-85dd-9329accefcb8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.511562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bde6b7ca48445638a8e6e302edb3923', 'request_id': 'req-5b82a82a-8580-4d4a-85dd-9329accefcb8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.530414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] The token cache is being invalidate because project 4bde6b7ca48445638a8e6e302edb3923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:14.531645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.533504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.540274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 997/1954] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:14 2022] DELETE /identity/v3/projects/4bde6b7ca48445638a8e6e302edb3923 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:14.548416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:14.559239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae968-27a5-444c-b070-d1f78d6fef77 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:14.629213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:14.731183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:14.732468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:14.732855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:14.733328 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] PATH_INFO: `/v3/users/0e793d3c434d437dbf094c06f4efc073` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:14.735433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e793d3c434d437dbf094c06f4efc073)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:14.737926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:14.817425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e793d3c434d437dbf094c06f4efc073'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.834214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e793d3c434d437dbf094c06f4efc073'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.849875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e793d3c434d437dbf094c06f4efc073'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.850768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e793d3c434d437dbf094c06f4efc073'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.851398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6e816474-e0f2-40d8-b67f-e85dc406da2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e793d3c434d437dbf094c06f4efc073'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:14.875950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 958/1955] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:14 2022] DELETE /identity/v3/users/0e793d3c434d437dbf094c06f4efc073 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:15.166511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.168074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:15.186198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82a82a-8580-4d4a-85dd-9329accefcb8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.258301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.259298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.259586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.259894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] PATH_INFO: `/v3/projects/a90563f378f0450fb07534922cf84020` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.261123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90563f378f0450fb07534922cf84020)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.263080 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.274950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:15.317340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90563f378f0450fb07534922cf84020', 'request_id': 'req-331ed506-ab8e-40a7-ac93-57005fc476b5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:15.323762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90563f378f0450fb07534922cf84020', 'request_id': 'req-331ed506-ab8e-40a7-ac93-57005fc476b5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:15.330073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90563f378f0450fb07534922cf84020', 'request_id': 'req-331ed506-ab8e-40a7-ac93-57005fc476b5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:15.344651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] The token cache is being invalidate because project a90563f378f0450fb07534922cf84020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:15.344950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:15.345588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-331ed506-ab8e-40a7-ac93-57005fc476b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:15.347152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 998/1956] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:15 2022] DELETE /identity/v3/projects/a90563f378f0450fb07534922cf84020 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:15.353171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.353566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.353857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.376317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:15.377615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:15.447536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 959/1957] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:15.455652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.457173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.457881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.476513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:15.477763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:15.486316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 999/1958] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:15.490597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.500823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ce77-383b-4aba-a76e-e5853f7054ea None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.505314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.505961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.506244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.506518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.507240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:15.507816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.509464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.521601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 960/1959] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:39:15.525912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.535543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e0da-c310-44c5-9f5f-49599fb8ba5e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.540264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.540913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.541194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.541467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.542162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.544163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.574220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1000/1960] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:15 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:15.575396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.585584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a616bd7-d69c-4c18-9e92-a74eefaeb307 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.613143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:15.653649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.654353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.654655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.654938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.656202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.658168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.683182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 961/1961] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:15 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:15.687552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.697816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b5441-fb76-44ae-8054-85550e23d93d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.704487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.705304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.705583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.705865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.706609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.708269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.719576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1001/1962] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:15.723021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.733315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de57b3-d2d3-42ea-aaa2-fc5933531a10 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.738224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea984806-ea97-4026-ab85-efee7b5cd0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.738904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea984806-ea97-4026-ab85-efee7b5cd0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.739193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea984806-ea97-4026-ab85-efee7b5cd0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.739477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea984806-ea97-4026-ab85-efee7b5cd0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.740253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea984806-ea97-4026-ab85-efee7b5cd0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.741881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea984806-ea97-4026-ab85-efee7b5cd0e2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.753624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 962/1963] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:15.757984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:15.769204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6afb11-c803-4bf8-a0cf-0ac717ed0568 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:15.774163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:15.780514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.781475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.781806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] PATH_INFO: `/v3/projects/727545c181fc4ab3962cf1acb8f96270/users/5ebbf0bb8ac14a54b39977d421fbf72c/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.798945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727545c181fc4ab3962cf1acb8f96270, user_id=5ebbf0bb8ac14a54b39977d421fbf72c, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:15.801844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:15.817037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1002/1964] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:15 2022] PUT /identity/v3/projects/727545c181fc4ab3962cf1acb8f96270/users/5ebbf0bb8ac14a54b39977d421fbf72c/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:15.828176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:15.828504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:15.829061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:15.863926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] MFA Rules not processed for user `5ebbf0bb8ac14a54b39977d421fbf72c`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:15.865343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:15.963926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 963/1965] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:15.965842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.043903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215ef9-69d8-49f5-a52b-33f93de264f5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.049486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.050216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.050568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.050910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.051669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.053737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.088242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1003/1966] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:15 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:16.092212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.104077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f5a85-7faf-490e-a940-750c3a92e453 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.168465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.169141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.169425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.169701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.170390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.172930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.195577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 964/1967] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:16 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:16.199621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.210185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb96e8-8bbb-4269-9089-17088a3fc430 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.214872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.215531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.215813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.216121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.216875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.218523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.229483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1004/1968] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:16.234742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.245032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e208ff-cdba-47aa-aae2-a8d52eaba53a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.251048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.252078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.252483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.252768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] PATH_INFO: `/v3/projects/24bc007a29eb4eca8ae05c2d69b1e3c7/users/1e2b16736fca4c41a7ce9ede97b99dae/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.275067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bc007a29eb4eca8ae05c2d69b1e3c7, user_id=1e2b16736fca4c41a7ce9ede97b99dae, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.277793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.290579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:16.300866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 965/1969] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:16 2022] PUT /identity/v3/projects/24bc007a29eb4eca8ae05c2d69b1e3c7/users/1e2b16736fca4c41a7ce9ede97b99dae/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:16.301592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.313165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6778-3cc1-42ba-acea-0dfeb4d234cf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.318900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:16.377338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c74a-2dd3-4e61-9217-5f19f7a4156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.378020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c74a-2dd3-4e61-9217-5f19f7a4156e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.378308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c74a-2dd3-4e61-9217-5f19f7a4156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.378592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c74a-2dd3-4e61-9217-5f19f7a4156e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.379327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64c74a-2dd3-4e61-9217-5f19f7a4156e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.380986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64c74a-2dd3-4e61-9217-5f19f7a4156e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.391696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1005/1970] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:16.395770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.406869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ebc8-3c51-4dfa-ae61-465a5e4bdb54 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.411383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.412301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.412586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.412855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] PATH_INFO: `/v3/projects/24bc007a29eb4eca8ae05c2d69b1e3c7/users/1e2b16736fca4c41a7ce9ede97b99dae/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.414816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bc007a29eb4eca8ae05c2d69b1e3c7, user_id=1e2b16736fca4c41a7ce9ede97b99dae, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.417518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.429519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 966/1971] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:16 2022] PUT /identity/v3/projects/24bc007a29eb4eca8ae05c2d69b1e3c7/users/1e2b16736fca4c41a7ce9ede97b99dae/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:16.440305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.440613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.440882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.469366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] MFA Rules not processed for user `1e2b16736fca4c41a7ce9ede97b99dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:16.470599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:16.539504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1006/1972] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:16.550851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.552635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:16.613951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7681bfa-6f8f-48b1-93e6-170553af49a7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.617970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.618650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.618937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.619213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.629618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.631155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.646605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 967/1973] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:16.744592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:16.755473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2920ca-9f42-4282-9b96-29a1a56fe1ab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:16.759318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6464d-8a74-4308-b850-4dfd3ad42b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:16.760004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6464d-8a74-4308-b850-4dfd3ad42b60 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:16.760290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6464d-8a74-4308-b850-4dfd3ad42b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:16.760570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6464d-8a74-4308-b850-4dfd3ad42b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:16.817629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6464d-8a74-4308-b850-4dfd3ad42b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:16.819070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6464d-8a74-4308-b850-4dfd3ad42b60 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:16.828398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1007/1974] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:19.412204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:19.488657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38a3a-1e15-4a4f-b02f-32729143e5e0 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:19.494829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:19.495421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:19.495715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:19.496024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] PATH_INFO: `/v3/users/5ebbf0bb8ac14a54b39977d421fbf72c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:19.506130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebbf0bb8ac14a54b39977d421fbf72c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:19.510184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:19.580619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebbf0bb8ac14a54b39977d421fbf72c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:19.603906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebbf0bb8ac14a54b39977d421fbf72c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:19.621938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebbf0bb8ac14a54b39977d421fbf72c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:19.622568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebbf0bb8ac14a54b39977d421fbf72c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:19.623176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebbf0bb8ac14a54b39977d421fbf72c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:19.636562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 968/1975] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:19 2022] DELETE /identity/v3/users/5ebbf0bb8ac14a54b39977d421fbf72c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:19.641774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:19.642351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:19.642351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:19.660050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:19.661258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:19.685068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:19.719633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1008/1976] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:39:19.729176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:19.730619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:19.742331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:19.790581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107b5a-0b84-4008-aed4-448e99b5150b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:19.794354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:19.795128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:19.795554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:19.795967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:19.805766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:19.807201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:19.817101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 969/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:20.243310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:20.244696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:20.259107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bbd83-ee00-423c-931f-7a6368682006 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:20.268404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:20.269403 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:20.269581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:20.269864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] PATH_INFO: `/v3/projects/727545c181fc4ab3962cf1acb8f96270` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:20.271244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727545c181fc4ab3962cf1acb8f96270)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:20.274369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:20.334979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727545c181fc4ab3962cf1acb8f96270', 'request_id': 'req-3113abd2-2e89-4789-90d4-cb3c64694f72'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.341810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727545c181fc4ab3962cf1acb8f96270', 'request_id': 'req-3113abd2-2e89-4789-90d4-cb3c64694f72'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.347821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727545c181fc4ab3962cf1acb8f96270', 'request_id': 'req-3113abd2-2e89-4789-90d4-cb3c64694f72'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.362315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] The token cache is being invalidate because project 727545c181fc4ab3962cf1acb8f96270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:20.362604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.363237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.364842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1009/1978] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:20 2022] DELETE /identity/v3/projects/727545c181fc4ab3962cf1acb8f96270 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:20.368812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:20.379272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff811-2da0-47ac-9b92-b16646974ce3 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:20.455671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:20.456592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:20.456899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:20.457141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] PATH_INFO: `/v3/users/1e2b16736fca4c41a7ce9ede97b99dae` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:20.460335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2b16736fca4c41a7ce9ede97b99dae)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:20.462519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:20.517791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2b16736fca4c41a7ce9ede97b99dae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.536688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2b16736fca4c41a7ce9ede97b99dae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.544308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2b16736fca4c41a7ce9ede97b99dae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.545021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2b16736fca4c41a7ce9ede97b99dae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.545690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f48ea8b7-1a68-48bf-8cde-e51872e3690b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2b16736fca4c41a7ce9ede97b99dae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.558563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 970/1979] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:20 2022] DELETE /identity/v3/users/1e2b16736fca4c41a7ce9ede97b99dae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:20.851549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:20.856763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:20.872396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113abd2-2e89-4789-90d4-cb3c64694f72 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:20.936142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:20.937613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:20.937909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:20.938183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] PATH_INFO: `/v3/projects/24bc007a29eb4eca8ae05c2d69b1e3c7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:20.939382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bc007a29eb4eca8ae05c2d69b1e3c7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:20.941342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:20.986653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bc007a29eb4eca8ae05c2d69b1e3c7', 'request_id': 'req-cd8d2464-7579-4175-a091-2646bf5230b7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.992571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bc007a29eb4eca8ae05c2d69b1e3c7', 'request_id': 'req-cd8d2464-7579-4175-a091-2646bf5230b7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:20.993733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:21.000096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bc007a29eb4eca8ae05c2d69b1e3c7', 'request_id': 'req-cd8d2464-7579-4175-a091-2646bf5230b7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:21.012659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] The token cache is being invalidate because project 24bc007a29eb4eca8ae05c2d69b1e3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:21.012953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:21.013689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cd8d2464-7579-4175-a091-2646bf5230b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:21.015519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1010/1980] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:20 2022] DELETE /identity/v3/projects/24bc007a29eb4eca8ae05c2d69b1e3c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:21.020406 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.020703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.020990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.040851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:21.041986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:21.069284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:21.104725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 971/1981] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:21.113240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.113619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.113964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.134359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:21.135725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:21.147229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1011/1982] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:39:21.150888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.164308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa3e6e-adf6-4e8e-b004-f42e4599e02e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.172586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.173700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.174025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.174368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.175952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:21.176270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.178040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.194771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 972/1983] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:39:21.199145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.209164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c482033-3680-4cc2-854e-ccdaf9eede3e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.213970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.214635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.214924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.215202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.215928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.218406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.253257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1012/1984] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:21.254499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.265455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92faaa4-5a8a-4224-926b-0d3f51f911bc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.322832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.323504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.323792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.324099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.324791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.326723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.347881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 973/1985] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:21.353092 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.363726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee965820-aab9-414a-9eb1-3cffd13ff289 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.368390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.369055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.369345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.369627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.370362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.372011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.383525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1013/1986] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:21.387539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.397956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e9d6-26f9-4db3-b104-db9b616d4910 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.402532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59137b11-5de2-425e-b667-972ce11134e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.403194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59137b11-5de2-425e-b667-972ce11134e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.403484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59137b11-5de2-425e-b667-972ce11134e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.403764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59137b11-5de2-425e-b667-972ce11134e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.404538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59137b11-5de2-425e-b667-972ce11134e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.406933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59137b11-5de2-425e-b667-972ce11134e3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.417132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 974/1987] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:21.421471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.431391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b1123-ea00-4b96-8527-c91fbd4e10e9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.436069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.437476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.437784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.438038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] PATH_INFO: `/v3/projects/6cc92f118ccb45a7a2273cde9aa7793c/users/0d32361600bf47c7a34ffda040de4fc0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.453555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc92f118ccb45a7a2273cde9aa7793c, user_id=0d32361600bf47c7a34ffda040de4fc0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.456334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.469537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1014/1988] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:21 2022] PUT /identity/v3/projects/6cc92f118ccb45a7a2273cde9aa7793c/users/0d32361600bf47c7a34ffda040de4fc0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:21.479523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.480004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.480116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.506869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] MFA Rules not processed for user `0d32361600bf47c7a34ffda040de4fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:21.508410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:21.573902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 975/1989] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:21.579577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.642565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549bac8-83da-4a3b-abd1-c8924714cec0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.647211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.647988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.648281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.648563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.649278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.651225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.681101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1015/1990] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:21.682258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.693823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c016c-8996-4f4e-9ebe-b8b5bce2341e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.720433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:21.756453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.757135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.757450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.757983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.758694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.760697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.782449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 976/1991] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:21 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:21.786454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.796831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6aaaa-fd02-42e6-bb91-14c52bfba33b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.801602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.802295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.802589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.802874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.803615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.805315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.816059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1016/1992] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:21.820098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.830943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c349f3-5425-4970-ab1e-0784800fce87 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.835613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.836542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.836826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.837100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] PATH_INFO: `/v3/projects/55609aaf7f2d4320a35201a5d6d8dc67/users/2c41ca6755d841deb796fafc29ced781/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.853605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55609aaf7f2d4320a35201a5d6d8dc67, user_id=2c41ca6755d841deb796fafc29ced781, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.856577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.871582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 977/1993] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:21 2022] PUT /identity/v3/projects/55609aaf7f2d4320a35201a5d6d8dc67/users/2c41ca6755d841deb796fafc29ced781/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:21.875662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.886258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b15e6f-5eee-4c1d-a29b-95ebfe2360c9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.941439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:21.953068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab60208-5699-4c0b-8b64-6ad78483b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.954194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60208-5699-4c0b-8b64-6ad78483b027 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.954530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60208-5699-4c0b-8b64-6ad78483b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.954805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60208-5699-4c0b-8b64-6ad78483b027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.955580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab60208-5699-4c0b-8b64-6ad78483b027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.957699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab60208-5699-4c0b-8b64-6ad78483b027 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:21.969473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1017/1994] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:21.973590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:21.984731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2260c-ebbc-4dc6-81ce-3efddbf58d48 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:21.989413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:21.990297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:21.990580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:21.990858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] PATH_INFO: `/v3/projects/55609aaf7f2d4320a35201a5d6d8dc67/users/2c41ca6755d841deb796fafc29ced781/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:21.992858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=55609aaf7f2d4320a35201a5d6d8dc67, user_id=2c41ca6755d841deb796fafc29ced781, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:21.995532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:22.006347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 978/1995] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:21 2022] PUT /identity/v3/projects/55609aaf7f2d4320a35201a5d6d8dc67/users/2c41ca6755d841deb796fafc29ced781/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:22.016785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:22.017075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:22.017352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:22.043582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] MFA Rules not processed for user `2c41ca6755d841deb796fafc29ced781`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:22.044828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:22.117425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1018/1996] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:39:22.128137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:22.130232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:22.190371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ef93-de67-4330-aca4-4c67bae2d3bb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:22.194025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ad3f3-f3c2-4728-be93-db8022237583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:22.194678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad3f3-f3c2-4728-be93-db8022237583 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:22.194969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad3f3-f3c2-4728-be93-db8022237583 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:22.195239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad3f3-f3c2-4728-be93-db8022237583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:22.252093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ad3f3-f3c2-4728-be93-db8022237583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:22.253600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ad3f3-f3c2-4728-be93-db8022237583 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:22.263479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 979/1997] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:28.622009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:28.623395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:28.689632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cda01e-31e9-4c38-9cec-d5507285861c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:28.694257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:28.695132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:28.695420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:28.695699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] PATH_INFO: `/v3/users/3db9f454080b4ab39eca8a8ac36e1efb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:28.696943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db9f454080b4ab39eca8a8ac36e1efb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:28.698930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:28.759618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db9f454080b4ab39eca8a8ac36e1efb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:28.773190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db9f454080b4ab39eca8a8ac36e1efb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:28.783177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db9f454080b4ab39eca8a8ac36e1efb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:28.783972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db9f454080b4ab39eca8a8ac36e1efb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:28.790238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:28.792455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db9f454080b4ab39eca8a8ac36e1efb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:28.801004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1019/1998] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:28 2022] DELETE /identity/v3/users/3db9f454080b4ab39eca8a8ac36e1efb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:28.805603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:28.806166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:28.806166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:28.830167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:28.831403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:28.879013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:28.927878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 980/1999] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:28.937819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:28.939254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:28.970665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:28.972128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:29.003771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64899b2-22dd-4f0b-b2a2-83f3ab879ebd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:29.008384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:29.009036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:29.009321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:29.009894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:29.024323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:29.026015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:29.036935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d6a1-8be0-48b2-8685-364029d99b20 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:29.037697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1020/2000] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:29.043465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:29.044153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:29.044501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:29.044783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:29.048211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:29.158890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:29.162114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:29.178271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 981/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:39:29.503450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:29.505047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:29.525392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23de841-d96e-4b7e-8b6d-19de6f847950 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:29.536569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:29.537458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:29.537735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:29.538013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] PATH_INFO: `/v3/projects/e285f6f2771a46e681b278a25d4f6fdb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:29.539345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e285f6f2771a46e681b278a25d4f6fdb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:29.541898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:29.672563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e285f6f2771a46e681b278a25d4f6fdb', 'request_id': 'req-cf87f059-3098-460f-a968-1167e937df2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.699045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e285f6f2771a46e681b278a25d4f6fdb', 'request_id': 'req-cf87f059-3098-460f-a968-1167e937df2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.705879 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e285f6f2771a46e681b278a25d4f6fdb', 'request_id': 'req-cf87f059-3098-460f-a968-1167e937df2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.726729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] The token cache is being invalidate because project e285f6f2771a46e681b278a25d4f6fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:29.727768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.728396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.734296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1021/2002] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:29 2022] DELETE /identity/v3/projects/e285f6f2771a46e681b278a25d4f6fdb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:29.734768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:29.747573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fe3c-332d-4118-b50d-0312672ec9dd service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:29.827080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:29.828669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:29.828965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:29.829338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] PATH_INFO: `/v3/users/036e27a7424642448dc92ce8ed45c2ea` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:29.830618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036e27a7424642448dc92ce8ed45c2ea)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:29.833228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:29.870211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:29.896489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036e27a7424642448dc92ce8ed45c2ea'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.912959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036e27a7424642448dc92ce8ed45c2ea'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.923314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036e27a7424642448dc92ce8ed45c2ea'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.924009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036e27a7424642448dc92ce8ed45c2ea'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.924621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b203a364-470a-4487-b1da-3c15150fc844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036e27a7424642448dc92ce8ed45c2ea'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:29.938809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 982/2003] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:29 2022] DELETE /identity/v3/users/036e27a7424642448dc92ce8ed45c2ea => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:30.279297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:30.281950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:30.304595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87f059-3098-460f-a968-1167e937df2e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:30.446776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:30.446776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:30.446776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:30.447083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] PATH_INFO: `/v3/projects/043e6a14306543fbbca3d215ea05849a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:30.450052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] RBAC: Authorizing `identity:delete_project(project_id=043e6a14306543fbbca3d215ea05849a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:30.452162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:30.484701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:30.560404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043e6a14306543fbbca3d215ea05849a', 'request_id': 'req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:30.578533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043e6a14306543fbbca3d215ea05849a', 'request_id': 'req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:30.602106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043e6a14306543fbbca3d215ea05849a', 'request_id': 'req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:30.622286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] The token cache is being invalidate because project 043e6a14306543fbbca3d215ea05849a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:30.622735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:30.623509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ba7ba99-6fd3-47e3-b7b0-ed8ce8db852f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:30.629107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1022/2004] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:30 2022] DELETE /identity/v3/projects/043e6a14306543fbbca3d215ea05849a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:30.630966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:30.631258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:30.631536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:30.658994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:30.661034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:30.764729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 983/2005] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:30.785498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:30.785992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:30.786102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:30.838977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:30.840435 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:30.860567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1023/2006] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:30.864929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:30.880330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cddecc-bab9-4952-909f-62af29c34c99 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:30.886236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:30.887346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:30.888490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:30.888971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:30.889913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:30.891945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:30.893805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:30.917909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:30.922296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 984/2007] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:39:30.930333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc4a0-b322-4b54-b7af-a62f462bdaaf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:30.940202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:30.941298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:30.941765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:30.942244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:30.943329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:30.945628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:30.980052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1024/2008] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:30 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:30.984927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:30.995166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ad667-b441-49e2-b16c-291df227604f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.060966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.061647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.061936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.062819 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.063619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.065837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.107121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 985/2009] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:30 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:31.108602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.124521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73357d-4912-4fdd-b05b-039944c37c9f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.132779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.133499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.133874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.134101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.135268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.137406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.151727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1025/2010] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:31.155795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.168107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a17bd-7670-47bd-9582-714e81d26ea7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.174414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47344-5c0c-43a9-ad8e-ee5fe91ca931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.175176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47344-5c0c-43a9-ad8e-ee5fe91ca931 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.175528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47344-5c0c-43a9-ad8e-ee5fe91ca931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.175906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47344-5c0c-43a9-ad8e-ee5fe91ca931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.177564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e47344-5c0c-43a9-ad8e-ee5fe91ca931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.178570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e47344-5c0c-43a9-ad8e-ee5fe91ca931 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.189468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 986/2011] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:31.193890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.205724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98092d48-66f0-4420-856c-7e9217877e42 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.211135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.212049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.212343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.212603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] PATH_INFO: `/v3/projects/0ad87fb1de2d43d6877f1811a64f26d7/users/24ea02a2fa1c4d2ba0ff6c22712245c2/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.228740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad87fb1de2d43d6877f1811a64f26d7, user_id=24ea02a2fa1c4d2ba0ff6c22712245c2, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.231855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.247156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1026/2012] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:31 2022] PUT /identity/v3/projects/0ad87fb1de2d43d6877f1811a64f26d7/users/24ea02a2fa1c4d2ba0ff6c22712245c2/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:31.259974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.260277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.260610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.280565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:31.290201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] MFA Rules not processed for user `24ea02a2fa1c4d2ba0ff6c22712245c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:31.292214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:31.360633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 987/2013] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:39:31.370320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.468210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21527-70c7-467d-a72d-01e39a92f787 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.473961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.474921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.475562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.476011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.476815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.479806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.534819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1027/2014] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:31 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:31.536216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.549856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78d5c-2730-4e10-9892-c51f5564de40 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.610606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.611299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.611575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.611876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.612574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.614555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.637649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 988/2015] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:31 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:31.638894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.650041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c3940-cde6-47e7-b2ca-2bf626bb88bd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.655012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.655656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.656066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.656528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.657283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.658936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.669593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1028/2016] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:31.674224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.684422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f323a0-8f24-492c-b665-98cb1e692be9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.689668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.690550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.690833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.691109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] PATH_INFO: `/v3/projects/4b0537d702344ad8a72908f843f2b5f3/users/69636506d42949f7b02ac50f5de55319/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.710127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0537d702344ad8a72908f843f2b5f3, user_id=69636506d42949f7b02ac50f5de55319, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.712953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.737223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 989/2017] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:31 2022] PUT /identity/v3/projects/4b0537d702344ad8a72908f843f2b5f3/users/69636506d42949f7b02ac50f5de55319/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:31.740995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.751112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b6572-f2bc-480a-8105-4e7e8c3be260 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.769338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:31.813844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e8c86-df5f-4e90-b01b-b128f04e76cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.814510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8c86-df5f-4e90-b01b-b128f04e76cc admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.814793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8c86-df5f-4e90-b01b-b128f04e76cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.815070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8c86-df5f-4e90-b01b-b128f04e76cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.815797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e8c86-df5f-4e90-b01b-b128f04e76cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.817441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e8c86-df5f-4e90-b01b-b128f04e76cc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.827554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1029/2018] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:31.831733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.842048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bcce4-7747-45ca-b061-38eadd38f3b0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:31.847864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:31.848809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.849041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.849321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] PATH_INFO: `/v3/projects/4b0537d702344ad8a72908f843f2b5f3/users/69636506d42949f7b02ac50f5de55319/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.851351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0537d702344ad8a72908f843f2b5f3, user_id=69636506d42949f7b02ac50f5de55319, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:31.854035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:31.865208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 990/2019] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:31 2022] PUT /identity/v3/projects/4b0537d702344ad8a72908f843f2b5f3/users/69636506d42949f7b02ac50f5de55319/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:31.875209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:31.875509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:31.875792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:31.901315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] MFA Rules not processed for user `69636506d42949f7b02ac50f5de55319`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:31.902535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:31.968236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1030/2020] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:31.980733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:31.982465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:32.040732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f10e4-f3d2-4412-9a93-b423bd70ef31 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:32.044427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:32.045068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:32.045355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:32.045634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:32.052584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:32.056779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:32.058495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:32.068232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 991/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:32.152822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:32.154351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:32.167872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67774eea-c162-4bf6-9ca7-b174a8a97122 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:32.173352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d8475-cbe0-495b-a12a-0b3307ba1507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:32.174119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d8475-cbe0-495b-a12a-0b3307ba1507 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:32.174505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d8475-cbe0-495b-a12a-0b3307ba1507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:32.174824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d8475-cbe0-495b-a12a-0b3307ba1507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:32.238157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d8475-cbe0-495b-a12a-0b3307ba1507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:32.239554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d8475-cbe0-495b-a12a-0b3307ba1507 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:32.249623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1031/2022] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:42.064325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:42.245078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=82 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:44.278480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:44.279957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:44.360861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605043-0434-4450-98d3-a74e8026e285 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:44.366699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:44.368234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:44.368527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:44.368808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] PATH_INFO: `/v3/users/0d32361600bf47c7a34ffda040de4fc0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:44.370291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d32361600bf47c7a34ffda040de4fc0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:44.372339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:44.448954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d32361600bf47c7a34ffda040de4fc0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:44.473181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d32361600bf47c7a34ffda040de4fc0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:44.489142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d32361600bf47c7a34ffda040de4fc0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:44.489974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d32361600bf47c7a34ffda040de4fc0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:44.490723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d32361600bf47c7a34ffda040de4fc0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:44.512040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 992/2023] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:44 2022] DELETE /identity/v3/users/0d32361600bf47c7a34ffda040de4fc0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:44.513414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:44.513886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:44.514002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:44.536624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:44.538416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:44.624768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1032/2024] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:44.633001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:44.634504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:44.703571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3f27-03bd-40cc-b12f-02ba7546412e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:44.708390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:44.709242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:44.709680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:44.709952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:44.722549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:44.724043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:44.738125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 993/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:45.143927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:45.145368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:45.157919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ece5cf-4f59-4ecf-9e82-21b47d2a6953 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:45.164285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:45.166202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:45.166488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:45.166768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] PATH_INFO: `/v3/projects/6cc92f118ccb45a7a2273cde9aa7793c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:45.168073 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc92f118ccb45a7a2273cde9aa7793c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:45.170017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:45.233167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc92f118ccb45a7a2273cde9aa7793c', 'request_id': 'req-02a37aa9-598f-4482-b148-ed8fae2f63a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.241273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc92f118ccb45a7a2273cde9aa7793c', 'request_id': 'req-02a37aa9-598f-4482-b148-ed8fae2f63a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.248077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc92f118ccb45a7a2273cde9aa7793c', 'request_id': 'req-02a37aa9-598f-4482-b148-ed8fae2f63a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.264190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] The token cache is being invalidate because project 6cc92f118ccb45a7a2273cde9aa7793c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:45.264483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.265498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.267565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1033/2026] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:45 2022] DELETE /identity/v3/projects/6cc92f118ccb45a7a2273cde9aa7793c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:45.271457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:45.283481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351571c-f357-481b-bae2-45439f25117a service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:45.305117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:45.370338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:45.370338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:45.370338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:45.370338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] PATH_INFO: `/v3/users/2c41ca6755d841deb796fafc29ced781` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:45.371569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c41ca6755d841deb796fafc29ced781)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:45.375956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:45.435675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c41ca6755d841deb796fafc29ced781'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.449664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c41ca6755d841deb796fafc29ced781'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.459739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c41ca6755d841deb796fafc29ced781'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.460695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c41ca6755d841deb796fafc29ced781'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.461375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35c77b59-9c51-4fba-b74e-2423f1de4cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c41ca6755d841deb796fafc29ced781'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.478230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 994/2027] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:45 2022] DELETE /identity/v3/users/2c41ca6755d841deb796fafc29ced781 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:45.506164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:45.508036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:45.523290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a37aa9-598f-4482-b148-ed8fae2f63a7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:45.599075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:45.600275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:45.600740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:45.601156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] PATH_INFO: `/v3/users/53249c6465d14f5b8aa033cf966098f7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:45.602837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=53249c6465d14f5b8aa033cf966098f7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:45.605366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:45.656567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:45.695034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53249c6465d14f5b8aa033cf966098f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.713634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53249c6465d14f5b8aa033cf966098f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.729140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53249c6465d14f5b8aa033cf966098f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.729951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53249c6465d14f5b8aa033cf966098f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.754248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53249c6465d14f5b8aa033cf966098f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:45.765972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1034/2028] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:45 2022] DELETE /identity/v3/users/53249c6465d14f5b8aa033cf966098f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:45.776316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:45.776880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:45.777436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:45.797053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:45.798285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:45.872084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 995/2029] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:45.884324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:45.887623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:45.946048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:45.947668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:45.980658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f45e7e-a0c5-48fe-83ba-8047b45bdbc1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:45.982985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6443b-442a-4b68-81a8-083333a30eef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:45.987750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:45.988715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:45.989055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:45.989528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:45.993489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:45.994037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:45.994334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:45.994654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] PATH_INFO: `/v3/projects/55609aaf7f2d4320a35201a5d6d8dc67` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:45.996011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55609aaf7f2d4320a35201a5d6d8dc67)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:45.998338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.000030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.001716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.029593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1035/2030] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:46.096688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:46.128811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55609aaf7f2d4320a35201a5d6d8dc67', 'request_id': 'req-873464a1-b769-4e75-b2f5-412037b8c02e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.158980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55609aaf7f2d4320a35201a5d6d8dc67', 'request_id': 'req-873464a1-b769-4e75-b2f5-412037b8c02e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.168038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.170416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.170540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55609aaf7f2d4320a35201a5d6d8dc67', 'request_id': 'req-873464a1-b769-4e75-b2f5-412037b8c02e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.192458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] The token cache is being invalidate because project 55609aaf7f2d4320a35201a5d6d8dc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:46.192868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.193635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-873464a1-b769-4e75-b2f5-412037b8c02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.195645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 996/2031] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:45 2022] DELETE /identity/v3/projects/55609aaf7f2d4320a35201a5d6d8dc67 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:46.196107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aba783-25cb-4ed1-a694-560f1137911a service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.203319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e5a0-001d-4cbf-9433-aa8389d5469d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.203880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e5a0-001d-4cbf-9433-aa8389d5469d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.204370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e5a0-001d-4cbf-9433-aa8389d5469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.224544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a8e5e5a0-001d-4cbf-9433-aa8389d5469d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:46.225915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a8e5e5a0-001d-4cbf-9433-aa8389d5469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.313510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 997/2032] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:46.315331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.315633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.316039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.336720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.338044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.338363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:46.338668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.339119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] PATH_INFO: `/v3/users/24ea02a2fa1c4d2ba0ff6c22712245c2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.339797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.340973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ea02a2fa1c4d2ba0ff6c22712245c2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.343500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.348907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 998/2033] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:46.352964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.362951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c40d64-2536-4e2a-a654-dfe35a23c6a6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.368395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.369076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.369347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.369656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.370349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:46.370656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.375174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.393054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 999/2034] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:39:46.393806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.406159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc69cee-9360-4cfa-9e93-cda3cfb57d47 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.411335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.412048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.412339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.412615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.413322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.415298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.463973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1000/2035] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:46.463973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.465569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.488799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ea02a2fa1c4d2ba0ff6c22712245c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.491739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:46.512178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ea02a2fa1c4d2ba0ff6c22712245c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.527538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ea02a2fa1c4d2ba0ff6c22712245c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.528932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ea02a2fa1c4d2ba0ff6c22712245c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.543441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ea02a2fa1c4d2ba0ff6c22712245c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.551785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1036/2036] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:46 2022] DELETE /identity/v3/users/24ea02a2fa1c4d2ba0ff6c22712245c2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:46.552898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.555631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.568452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68507d4-0119-49c0-bbad-9d198556db5f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.614965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:46.652097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.653215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.653215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.653541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] PATH_INFO: `/v3/projects/1f27e44dedee4233a4fa5a6cac73ae97` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.654720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f27e44dedee4233a4fa5a6cac73ae97)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.657007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.669547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36b74-89e2-4a4c-a132-ef2a4c553fcd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.675743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985bdf-477d-4303-b24d-97023043adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.676791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985bdf-477d-4303-b24d-97023043adce admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.677254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985bdf-477d-4303-b24d-97023043adce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.677748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985bdf-477d-4303-b24d-97023043adce admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.678929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985bdf-477d-4303-b24d-97023043adce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.682534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985bdf-477d-4303-b24d-97023043adce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.711205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1037/2037] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:46.712389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da941baa-c31a-48f6-bed1-bc6714bbe9c0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.712808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da941baa-c31a-48f6-bed1-bc6714bbe9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.713095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da941baa-c31a-48f6-bed1-bc6714bbe9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.718473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f27e44dedee4233a4fa5a6cac73ae97', 'request_id': 'req-9045a539-5b03-46d1-b709-85608f1d8a1a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.724795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f27e44dedee4233a4fa5a6cac73ae97', 'request_id': 'req-9045a539-5b03-46d1-b709-85608f1d8a1a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.730150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f27e44dedee4233a4fa5a6cac73ae97', 'request_id': 'req-9045a539-5b03-46d1-b709-85608f1d8a1a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.736422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-da941baa-c31a-48f6-bed1-bc6714bbe9c0 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:46.737766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-da941baa-c31a-48f6-bed1-bc6714bbe9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.743431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] The token cache is being invalidate because project 1f27e44dedee4233a4fa5a6cac73ae97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:46.743667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.745145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:46.746955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1001/2038] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:46 2022] DELETE /identity/v3/projects/1f27e44dedee4233a4fa5a6cac73ae97 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:46.747475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.750987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.808817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1038/2039] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:46.810412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.810701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.810977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.820098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045a539-5b03-46d1-b709-85608f1d8a1a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.824940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c726596-dd78-4520-9cbe-2cd91360871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.825732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c726596-dd78-4520-9cbe-2cd91360871c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.826017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c726596-dd78-4520-9cbe-2cd91360871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.826293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c726596-dd78-4520-9cbe-2cd91360871c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.827126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c726596-dd78-4520-9cbe-2cd91360871c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.828737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c726596-dd78-4520-9cbe-2cd91360871c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.829543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:46.830795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.838804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1039/2040] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:46.838955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1002/2041] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:46.839582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.840825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.847401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.847799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.848293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.866756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:46.868010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:46.876994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1003/2042] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:46.877766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.887222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fb373-b267-4b52-9325-cadb4f9532ba None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.892598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.893330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.893670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.893896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.894650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.894802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:46.896562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.898760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c0fa4-d3fb-4ee8-8601-68444e4daaf2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.903229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.904264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.904811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.905164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.908130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1004/2043] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:46.909005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.918719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.920201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.921856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce966019-ab8f-4108-9ca2-6f707a757898 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.926487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.927124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.927413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.927693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.928455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:46.928767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.929996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1040/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:46.930424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.930768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.940721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d30c2-e021-4731-938a-c61ebcbee693 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.945811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1005/2045] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:39:46.945910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58577092-aef7-4640-8bfa-394230ea229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.946595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577092-aef7-4640-8bfa-394230ea229f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.946887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577092-aef7-4640-8bfa-394230ea229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.947164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577092-aef7-4640-8bfa-394230ea229f admin admin] PATH_INFO: `/v3/projects/f7201f0c6ab64901a15c6b8588a8f3fd/users/1fcb1a1d12c543378d9405606ad84523/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.949865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:46.961577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41221e5-71cf-41a0-b32a-31cc0205df88 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:46.963940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58577092-aef7-4640-8bfa-394230ea229f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7201f0c6ab64901a15c6b8588a8f3fd, user_id=1fcb1a1d12c543378d9405606ad84523, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.966582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58577092-aef7-4640-8bfa-394230ea229f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.966699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:46.967381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.967818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.968211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:46.969040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:46.971126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:46.984963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1041/2046] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:46 2022] PUT /identity/v3/projects/f7201f0c6ab64901a15c6b8588a8f3fd/users/1fcb1a1d12c543378d9405606ad84523/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:46.997369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:46.997805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:46.998003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.004165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1006/2047] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:47.008189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.015870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:47.034497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] MFA Rules not processed for user `1fcb1a1d12c543378d9405606ad84523`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:47.035865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:47.089572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5d6b-37a9-4d53-9781-49fe5ffe4b25 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.095806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.096615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.096978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.097469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.098207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.101977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.112088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1042/2048] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:47.126322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.129232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:47.129593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1007/2049] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:47 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:47.134061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.144415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a51d8-2ae3-4cad-aa81-d153df7b57d6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.148768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.149430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.149714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.149993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.150728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.152389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.163735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1008/2050] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:47.168640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.181317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827020f1-9b16-4781-afe4-8be9b3227595 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.188193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.189126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.189626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.189965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.190778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.192533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.201979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d69b0-2d5d-48ac-8c27-57e9082fd0c2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.204679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1009/2051] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:47.206450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.207121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.207404 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.207684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.209590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.220327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.221040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1bdb-8159-4dff-b120-1369117cafe6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.221869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.226010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6bc16-5eac-40b9-b3f2-12043faa94be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.227040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6bc16-5eac-40b9-b3f2-12043faa94be admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.227329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6bc16-5eac-40b9-b3f2-12043faa94be admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.227619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6bc16-5eac-40b9-b3f2-12043faa94be admin admin] PATH_INFO: `/v3/projects/79a60c2a91f9450ca42ed5166683700c/users/eb05cb47efb44f0382b5fef01ee0a780/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.234342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1043/2052] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:47.236207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.237782 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:47.256274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7692b-6bd8-45dc-aeac-5a9101f1f31e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.256663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6bc16-5eac-40b9-b3f2-12043faa94be admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a60c2a91f9450ca42ed5166683700c, user_id=eb05cb47efb44f0382b5fef01ee0a780, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.259741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6bc16-5eac-40b9-b3f2-12043faa94be admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.262800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.264441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.266082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.266520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] PATH_INFO: `/v3/projects/0ad87fb1de2d43d6877f1811a64f26d7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.275205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad87fb1de2d43d6877f1811a64f26d7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.276888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1010/2053] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:47 2022] PUT /identity/v3/projects/79a60c2a91f9450ca42ed5166683700c/users/eb05cb47efb44f0382b5fef01ee0a780/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:47.277652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.288602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.288956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.289308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.317389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] MFA Rules not processed for user `eb05cb47efb44f0382b5fef01ee0a780`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:47.318815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:47.333631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad87fb1de2d43d6877f1811a64f26d7', 'request_id': 'req-90832212-0a28-468f-aad7-e32cff7a7c98'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.341272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad87fb1de2d43d6877f1811a64f26d7', 'request_id': 'req-90832212-0a28-468f-aad7-e32cff7a7c98'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.343423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:47.349796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad87fb1de2d43d6877f1811a64f26d7', 'request_id': 'req-90832212-0a28-468f-aad7-e32cff7a7c98'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.364932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] The token cache is being invalidate because project 0ad87fb1de2d43d6877f1811a64f26d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:47.365224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.365925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.367646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1044/2054] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:47 2022] DELETE /identity/v3/projects/0ad87fb1de2d43d6877f1811a64f26d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:47.372856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.375121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:47.395787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1011/2055] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:47.409180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:47.411261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:47.464036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832212-0a28-468f-aad7-e32cff7a7c98 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.469872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.470897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.471193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.471528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] PATH_INFO: `/v3/users/69636506d42949f7b02ac50f5de55319` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.472919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69636506d42949f7b02ac50f5de55319)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.475622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.487649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:47.518590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b82a-fd15-4fa4-9512-1d22c3193b9d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:47.524961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:47.525751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:47.526249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:47.526409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:47.540647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:47.542292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:47.555809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1012/2056] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:47.564133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69636506d42949f7b02ac50f5de55319'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.581148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69636506d42949f7b02ac50f5de55319'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.596129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69636506d42949f7b02ac50f5de55319'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.598099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69636506d42949f7b02ac50f5de55319'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.626418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b6de344d-0397-413e-a53d-90d935c7d08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69636506d42949f7b02ac50f5de55319'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:47.634413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1045/2057] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:47 2022] DELETE /identity/v3/users/69636506d42949f7b02ac50f5de55319 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:47.996129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.027044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34f08-3cbb-447a-aaf4-21d8e7a82b46 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.090428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.091301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.091590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.091883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] PATH_INFO: `/v3/projects/4b0537d702344ad8a72908f843f2b5f3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.094104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0537d702344ad8a72908f843f2b5f3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.096088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.152458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0537d702344ad8a72908f843f2b5f3', 'request_id': 'req-4676e747-d01c-4b18-b31a-41c13c10086d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:48.159129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0537d702344ad8a72908f843f2b5f3', 'request_id': 'req-4676e747-d01c-4b18-b31a-41c13c10086d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:48.164640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0537d702344ad8a72908f843f2b5f3', 'request_id': 'req-4676e747-d01c-4b18-b31a-41c13c10086d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:48.177207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] The token cache is being invalidate because project 4b0537d702344ad8a72908f843f2b5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:48.177505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:48.178178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4676e747-d01c-4b18-b31a-41c13c10086d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:48.179717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1013/2058] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:47 2022] DELETE /identity/v3/projects/4b0537d702344ad8a72908f843f2b5f3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:48.184591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.184887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.185167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.204010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:48.205212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:48.262820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1046/2059] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:48.271428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.271720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.272040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.290323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:48.291518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:48.299391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1014/2060] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:48.303510 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.308403 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:48.315607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac48a0-6fd3-4202-be91-ba7b2e4370e7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.321323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.321972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.322261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.322541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.323276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:48.323587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.325266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.337292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1047/2061] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:39:48.341651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.351972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db43185-5b5c-4f6c-9cf1-448b39df5778 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.356515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.357164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.357446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.357720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.358436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.360535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.387826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1015/2062] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:48.392167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.404725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b9dc-88bf-4692-a2e2-b63b2285857a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.463784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.464478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.464764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.465041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.465733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.468249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.495026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1048/2063] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:48.496270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.507224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b77a6-8f5a-41d7-9e32-22c7a8b0d8c8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.512184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.512914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.513151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.513428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.514159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.515878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.526590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1016/2064] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:48.532063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.543427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d12cdd-f866-4e8e-951b-29a0c92caf5d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.548833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c990a6-e31f-4ea7-ad66-d73c71a400c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.549485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c990a6-e31f-4ea7-ad66-d73c71a400c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.549767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c990a6-e31f-4ea7-ad66-d73c71a400c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.550068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c990a6-e31f-4ea7-ad66-d73c71a400c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.550843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c990a6-e31f-4ea7-ad66-d73c71a400c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.552478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c990a6-e31f-4ea7-ad66-d73c71a400c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.562959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1049/2065] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:48.567918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.578313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c5cf1-a09a-4bcb-937d-feb215a6feff admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.582878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311e0a5-33a3-43c6-a31b-5f1a1f602c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.583751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e0a5-33a3-43c6-a31b-5f1a1f602c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.584065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e0a5-33a3-43c6-a31b-5f1a1f602c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.584340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e0a5-33a3-43c6-a31b-5f1a1f602c5b admin admin] PATH_INFO: `/v3/projects/406ae1d001714421beab3c211e486741/users/7da4e84be8e940eb9a8b5f73fc624c24/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.599887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311e0a5-33a3-43c6-a31b-5f1a1f602c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=406ae1d001714421beab3c211e486741, user_id=7da4e84be8e940eb9a8b5f73fc624c24, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.602633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311e0a5-33a3-43c6-a31b-5f1a1f602c5b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.615654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1017/2066] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:48 2022] PUT /identity/v3/projects/406ae1d001714421beab3c211e486741/users/7da4e84be8e940eb9a8b5f73fc624c24/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:48.627857 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54473-0be2-455a-a395-854522e14719 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.628488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54473-0be2-455a-a395-854522e14719 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.628488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54473-0be2-455a-a395-854522e14719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.665102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5bf54473-0be2-455a-a395-854522e14719 None None] MFA Rules not processed for user `7da4e84be8e940eb9a8b5f73fc624c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:48.667041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5bf54473-0be2-455a-a395-854522e14719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:48.719340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.719640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.719959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.731988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:48.739757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] MFA Rules not processed for user `1fcb1a1d12c543378d9405606ad84523`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:48.742247 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:48.759702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1050/2067] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:48.763947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54473-0be2-455a-a395-854522e14719 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.820944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1018/2068] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:39:48.843920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:48.851577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54473-0be2-455a-a395-854522e14719 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.857457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.858494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.858859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.859198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.860010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.862229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:48.894660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1051/2069] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:48.898853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:48.910762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526792a-3859-4eca-bd15-1f3f2f0ff196 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:48.977234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:48.977931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:48.978215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:48.978490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:48.979179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:48.981164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.002603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1019/2070] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:48 2022] POST /identity/v3/users => generated 307 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:49.006542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:49.019903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedf9e-2e1f-4bdd-9461-6fbc91b777eb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:49.025045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:49.025718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.026050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.026330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.027069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:49.028904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.044141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1052/2071] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:49.045371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:49.056614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3792a91-4548-4b46-9c35-b670f5a8680d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:49.062270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:49.063287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.063812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.064217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] PATH_INFO: `/v3/projects/55b62456272a4567934b51d9f975828b/users/0135bc0d1a9844c7b62eda8cef41d422/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.088828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b62456272a4567934b51d9f975828b, user_id=0135bc0d1a9844c7b62eda8cef41d422, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:49.091897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.113062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1020/2072] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:49 2022] PUT /identity/v3/projects/55b62456272a4567934b51d9f975828b/users/0135bc0d1a9844c7b62eda8cef41d422/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:49.114101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:49.133271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b84f8e-fdeb-42b5-9bfe-53e8f94af746 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:49.191332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6bca0-1d09-4661-9037-853540cfd31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:49.192033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6bca0-1d09-4661-9037-853540cfd31a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.192347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6bca0-1d09-4661-9037-853540cfd31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.192625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6bca0-1d09-4661-9037-853540cfd31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.193364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6bca0-1d09-4661-9037-853540cfd31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:49.194980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6bca0-1d09-4661-9037-853540cfd31a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.211488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1053/2073] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:49.215779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:49.227091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832358b1-468a-4360-ad3b-c0438b4a4777 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:49.232360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:49.233539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.233934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.234330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] PATH_INFO: `/v3/projects/55b62456272a4567934b51d9f975828b/users/0135bc0d1a9844c7b62eda8cef41d422/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.236580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b62456272a4567934b51d9f975828b, user_id=0135bc0d1a9844c7b62eda8cef41d422, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:49.239257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.250863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1021/2074] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:49 2022] PUT /identity/v3/projects/55b62456272a4567934b51d9f975828b/users/0135bc0d1a9844c7b62eda8cef41d422/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:49.262279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.262585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.262860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.295150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] MFA Rules not processed for user `0135bc0d1a9844c7b62eda8cef41d422`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:49.297165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:49.374713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1054/2075] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:49.385146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:49.391908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:49.454738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9acba5-dbcd-4b5d-a14a-ba7cd5384374 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:49.458454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:49.459105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.459454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.459672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.470657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:49.472474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.482815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1022/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:49.591943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:49.613059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb93fe-78e6-48bd-84a8-449d9412e6a0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:49.618511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622d76e-750b-4ddf-a472-b6ab277372ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:49.619379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622d76e-750b-4ddf-a472-b6ab277372ec service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:49.620219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622d76e-750b-4ddf-a472-b6ab277372ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:49.620842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622d76e-750b-4ddf-a472-b6ab277372ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:49.685562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:49.697450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622d76e-750b-4ddf-a472-b6ab277372ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:49.699635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622d76e-750b-4ddf-a472-b6ab277372ec service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:49.712167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1055/2077] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:39:57.096171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:57.104667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:57.163924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70da0-5acf-40d0-ba70-ca9d74285dbf service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:57.168521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:57.169396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:57.169680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:57.170102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] PATH_INFO: `/v3/users/7da4e84be8e940eb9a8b5f73fc624c24` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:57.171323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da4e84be8e940eb9a8b5f73fc624c24)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:57.174469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:57.223262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da4e84be8e940eb9a8b5f73fc624c24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.236717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da4e84be8e940eb9a8b5f73fc624c24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.244520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da4e84be8e940eb9a8b5f73fc624c24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.245130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da4e84be8e940eb9a8b5f73fc624c24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.245733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da4e84be8e940eb9a8b5f73fc624c24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.258869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1023/2078] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:57 2022] DELETE /identity/v3/users/7da4e84be8e940eb9a8b5f73fc624c24 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:57.263249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:57.263769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:57.264066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:57.281963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:57.283323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:57.345343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1056/2079] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:57.354788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:57.356223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:57.414224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306b1a8-c863-43ad-a188-a30848ebb73d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:57.417956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:57.418615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:57.418887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:57.419167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:57.428222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:57.429650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:57.439540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1024/2080] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:57.710135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:57.711577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:57.724219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fdb98-aabf-4106-8b83-c16eb6ccaa53 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:57.729119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:57.729981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:57.730271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:57.730550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] PATH_INFO: `/v3/projects/406ae1d001714421beab3c211e486741` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:57.731866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406ae1d001714421beab3c211e486741)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:57.733818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:57.783374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406ae1d001714421beab3c211e486741', 'request_id': 'req-f455233d-c20f-4b3f-9abf-b594f090b9c7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.789562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406ae1d001714421beab3c211e486741', 'request_id': 'req-f455233d-c20f-4b3f-9abf-b594f090b9c7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.795230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406ae1d001714421beab3c211e486741', 'request_id': 'req-f455233d-c20f-4b3f-9abf-b594f090b9c7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.807754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] The token cache is being invalidate because project 406ae1d001714421beab3c211e486741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:57.808075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.808729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.810282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1057/2081] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:57 2022] DELETE /identity/v3/projects/406ae1d001714421beab3c211e486741 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:57.814897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:57.824486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5709a-d68f-4330-ac4a-421f19267ae0 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:57.849214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:57.880791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:57.881662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:57.881951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:57.882482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] PATH_INFO: `/v3/users/0135bc0d1a9844c7b62eda8cef41d422` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:57.883678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0135bc0d1a9844c7b62eda8cef41d422)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:57.885905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:57.929907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0135bc0d1a9844c7b62eda8cef41d422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.942198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0135bc0d1a9844c7b62eda8cef41d422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.948756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0135bc0d1a9844c7b62eda8cef41d422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.949504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0135bc0d1a9844c7b62eda8cef41d422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.950124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-882d5785-32ca-4c80-8885-637a45f6d954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0135bc0d1a9844c7b62eda8cef41d422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:57.962141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1025/2082] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:39:57 2022] DELETE /identity/v3/users/0135bc0d1a9844c7b62eda8cef41d422 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:58.271050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.272555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:58.293057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455233d-c20f-4b3f-9abf-b594f090b9c7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.374355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.375470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.375931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.376257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] PATH_INFO: `/v3/projects/55b62456272a4567934b51d9f975828b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.377593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b62456272a4567934b51d9f975828b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.379698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.399539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:58.432358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b62456272a4567934b51d9f975828b', 'request_id': 'req-31a1f430-270f-4b63-abdf-f3f187a28a74'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:58.439146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b62456272a4567934b51d9f975828b', 'request_id': 'req-31a1f430-270f-4b63-abdf-f3f187a28a74'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:58.444817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b62456272a4567934b51d9f975828b', 'request_id': 'req-31a1f430-270f-4b63-abdf-f3f187a28a74'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:58.458454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] The token cache is being invalidate because project 55b62456272a4567934b51d9f975828b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:39:58.458771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:58.459567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31a1f430-270f-4b63-abdf-f3f187a28a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:39:58.461060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1058/2083] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:39:58 2022] DELETE /identity/v3/projects/55b62456272a4567934b51d9f975828b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:58.465807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.466285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.466417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.485358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:58.486562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:58.547596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1026/2084] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:58.554814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.555108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.555391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.573875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:58.575069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:58.583134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1059/2085] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:58.587189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.596853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e335-1155-44a0-a74e-e616da019a9e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.601316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.601963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.602248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.602525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.603253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:39:58.603566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.605213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.617135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1027/2086] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:39:58.621197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.631231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc971ba4-ab95-412e-a31f-82ccfa851cdd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.636151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.636802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.637093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.637373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.638061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.640027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.667310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1060/2087] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:58 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:58.670652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.681039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce5f99-f3f8-4147-8d27-912262f51a97 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.713106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:58.739786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.740467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.740751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.741026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.741728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.743653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.770044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1028/2088] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:58 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:58.774242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.784713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0caf6e-83e8-4f64-85ec-61ce944cfbbb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.789313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.789976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.790262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.790540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.791274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.792912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.803825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1061/2089] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:39:58.807885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.818289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8efa27-00f7-4b16-9727-c8ca2713cfea admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.822773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce382-d63a-4fa8-873a-f854878f65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.823421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce382-d63a-4fa8-873a-f854878f65a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.823702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce382-d63a-4fa8-873a-f854878f65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.824016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce382-d63a-4fa8-873a-f854878f65a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.824744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce382-d63a-4fa8-873a-f854878f65a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.826325 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce382-d63a-4fa8-873a-f854878f65a1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.836839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1029/2090] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:58.840822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:58.850740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbaa24-a6dd-4df3-8aba-9b6c0cbd1b8e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:58.855250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:58.856149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.856436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.856713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] PATH_INFO: `/v3/projects/2d68c5d608ac49a2aa1e058da6af37a4/users/5b6d9fcdbbac4170961b357293f5d225/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.871601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d68c5d608ac49a2aa1e058da6af37a4, user_id=5b6d9fcdbbac4170961b357293f5d225, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:58.874391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:58.887542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1062/2091] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:58 2022] PUT /identity/v3/projects/2d68c5d608ac49a2aa1e058da6af37a4/users/5b6d9fcdbbac4170961b357293f5d225/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:39:58.898793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:58.899086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:58.899362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:58.926321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] MFA Rules not processed for user `5b6d9fcdbbac4170961b357293f5d225`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:58.927567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:58.990723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1030/2092] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:58.995104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.056636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e6c44-639c-42aa-aa21-cbeda098931a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.061329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.061985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.062890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.063144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.063868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.065816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.094153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1063/2093] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:39:58 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:39:59.098528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.109690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f98daa-eb01-44be-82df-5f35c1913213 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.165335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.165928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.166215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.166493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.167195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.169177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.190272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1031/2094] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:39:59 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:39:59.194266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.207318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64922b-0c4d-4637-b80c-7e8272d4381b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.214065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.214739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.215030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.215394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.216090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.217717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.231984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1064/2095] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:59.233345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.243992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64143ec-8af3-4fd8-8367-7a40513c7a7f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.248617 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.249497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.250496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.250767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] PATH_INFO: `/v3/projects/0435ecd7d55343158f5c23e12a34356c/users/1ff3e7aa33394ddc8eedece624c0e631/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.266111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0435ecd7d55343158f5c23e12a34356c, user_id=1ff3e7aa33394ddc8eedece624c0e631, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.268853 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.284084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1032/2096] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:59 2022] PUT /identity/v3/projects/0435ecd7d55343158f5c23e12a34356c/users/1ff3e7aa33394ddc8eedece624c0e631/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:59.287918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.299348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca80da8-5be7-4068-aaf4-1726cd12f9e0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.310932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:59.360158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc44885-95a5-4337-b08e-bd158f0edc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.360827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc44885-95a5-4337-b08e-bd158f0edc7e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.361113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc44885-95a5-4337-b08e-bd158f0edc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.361890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc44885-95a5-4337-b08e-bd158f0edc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.362100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc44885-95a5-4337-b08e-bd158f0edc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.363731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc44885-95a5-4337-b08e-bd158f0edc7e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.373720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1065/2097] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:39:59.378197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.388947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d0f72-b11e-420a-9035-0dd8b873c26f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.394292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.395375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.395895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.396298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] PATH_INFO: `/v3/projects/0435ecd7d55343158f5c23e12a34356c/users/1ff3e7aa33394ddc8eedece624c0e631/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.398492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0435ecd7d55343158f5c23e12a34356c, user_id=1ff3e7aa33394ddc8eedece624c0e631, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.401635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.404999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:59.419290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1033/2098] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:39:59 2022] PUT /identity/v3/projects/0435ecd7d55343158f5c23e12a34356c/users/1ff3e7aa33394ddc8eedece624c0e631/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:39:59.425970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.426294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.426598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.458503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] MFA Rules not processed for user `1ff3e7aa33394ddc8eedece624c0e631`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:39:59.464904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:59.553099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1066/2099] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:39:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:39:59.564251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.566098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:39:59.629729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4851-e358-4966-85d2-42be7c62efaf admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.639895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.640676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.640966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.641241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.650546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.652014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.661902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1034/2100] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:39:59.740660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:39:59.750268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05974835-f481-4616-9c79-d2b7254c0df7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:39:59.754019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403277a9-41d8-48fc-b6e3-aab63ee638b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:39:59.754668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403277a9-41d8-48fc-b6e3-aab63ee638b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:39:59.754950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403277a9-41d8-48fc-b6e3-aab63ee638b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:39:59.755223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403277a9-41d8-48fc-b6e3-aab63ee638b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:39:59.817946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403277a9-41d8-48fc-b6e3-aab63ee638b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:39:59.819397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403277a9-41d8-48fc-b6e3-aab63ee638b4 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:39:59.828723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1067/2101] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:39:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:09.657967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=28 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:09.814795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:09.824146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:09.901697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060c53e-05b3-4a3d-bc41-d1fe4cfe50f8 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:09.907709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:09.909073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:09.909421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:09.909868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] PATH_INFO: `/v3/users/5b6d9fcdbbac4170961b357293f5d225` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:09.911359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6d9fcdbbac4170961b357293f5d225)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:09.913639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:09.972730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6d9fcdbbac4170961b357293f5d225'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:09.986441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6d9fcdbbac4170961b357293f5d225'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:09.995901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6d9fcdbbac4170961b357293f5d225'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:09.996639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6d9fcdbbac4170961b357293f5d225'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:09.997494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6d9fcdbbac4170961b357293f5d225'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.021292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1035/2102] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:40:09 2022] DELETE /identity/v3/users/5b6d9fcdbbac4170961b357293f5d225 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:10.027046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:10.027507 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:10.028060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:10.054214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:10.056057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:10.122376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1068/2103] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:10.132465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:10.135495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:10.198804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b02386-ede6-4a89-96fa-844b49a303cd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:10.203766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:10.204466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:10.204768 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:10.205039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:10.228345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:10.229857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:10.240755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1036/2104] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:10.572348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:10.573887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:10.587653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbd443-baf6-48b4-9f68-9176ec664c33 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:10.592282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:10.593198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:10.593466 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:10.593835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] PATH_INFO: `/v3/projects/2d68c5d608ac49a2aa1e058da6af37a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:10.595036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d68c5d608ac49a2aa1e058da6af37a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:10.597024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:10.643032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d68c5d608ac49a2aa1e058da6af37a4', 'request_id': 'req-78329e2b-dbff-428a-b996-8c1f20ed41ed'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.648972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d68c5d608ac49a2aa1e058da6af37a4', 'request_id': 'req-78329e2b-dbff-428a-b996-8c1f20ed41ed'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.654472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d68c5d608ac49a2aa1e058da6af37a4', 'request_id': 'req-78329e2b-dbff-428a-b996-8c1f20ed41ed'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.668252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] The token cache is being invalidate because project 2d68c5d608ac49a2aa1e058da6af37a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:40:10.668541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.669153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.670704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1069/2105] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:40:10 2022] DELETE /identity/v3/projects/2d68c5d608ac49a2aa1e058da6af37a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:10.675397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:10.685298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a07f49-ef96-4a7d-a7d0-564000f7991b service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:10.707295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:10.751686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:10.752738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:10.753094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:10.753447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] PATH_INFO: `/v3/users/1ff3e7aa33394ddc8eedece624c0e631` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:10.754753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff3e7aa33394ddc8eedece624c0e631)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:10.756764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:10.807788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff3e7aa33394ddc8eedece624c0e631'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.819858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff3e7aa33394ddc8eedece624c0e631'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.829487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff3e7aa33394ddc8eedece624c0e631'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.830213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff3e7aa33394ddc8eedece624c0e631'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.830908 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0229998a-8dd6-4660-aa19-829a67c244ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff3e7aa33394ddc8eedece624c0e631'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:10.843999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1037/2106] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:40:10 2022] DELETE /identity/v3/users/1ff3e7aa33394ddc8eedece624c0e631 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:11.141726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.143868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:11.172070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78329e2b-dbff-428a-b996-8c1f20ed41ed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.235066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.236040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.236395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.236763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] PATH_INFO: `/v3/projects/0435ecd7d55343158f5c23e12a34356c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.238054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0435ecd7d55343158f5c23e12a34356c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.240116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.273992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:11.294731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0435ecd7d55343158f5c23e12a34356c', 'request_id': 'req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:11.302504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0435ecd7d55343158f5c23e12a34356c', 'request_id': 'req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:11.310514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0435ecd7d55343158f5c23e12a34356c', 'request_id': 'req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:11.324622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] The token cache is being invalidate because project 0435ecd7d55343158f5c23e12a34356c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:40:11.324995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:11.325633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf5c92c1-6463-41fb-a766-8d70ec5f4eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:11.327566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1070/2107] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:40:11 2022] DELETE /identity/v3/projects/0435ecd7d55343158f5c23e12a34356c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:11.333724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.334016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.334294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.356477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:11.357703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:11.431613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1038/2108] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:11.441446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.441736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.442084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.461807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:11.463025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:11.471672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1071/2109] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:11.475869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.489226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df9e0f-709f-4f85-9e57-7ed081e58623 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.495198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.496627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.496996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.497763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.507723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:40:11.507723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.507723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.524926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1039/2110] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:40:11.528837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.541759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3196b-5ccb-41c7-b070-e260ec5dd28e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.550021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.550622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.550909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.551187 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.551929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.553918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.586921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1072/2111] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:40:11 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:11.588121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.599893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1199-f35b-4067-81a5-a46653d4f00e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.627458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:11.659628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.660333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.660622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.660901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.661599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.663571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.684704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1040/2112] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:40:11 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:11.689504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.700033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbfe7d-7cf0-483e-9373-4a85fa8f0e05 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.705082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.705822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.706199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.706629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.707392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.709171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.722967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1073/2113] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:11.724399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.737044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc12e4-a483-4763-a81d-bce31583445f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.741636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc527d7-f9ba-4a95-9989-67d12c9b5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.742297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc527d7-f9ba-4a95-9989-67d12c9b5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.742585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc527d7-f9ba-4a95-9989-67d12c9b5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.742865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc527d7-f9ba-4a95-9989-67d12c9b5ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.743610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc527d7-f9ba-4a95-9989-67d12c9b5ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.745250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc527d7-f9ba-4a95-9989-67d12c9b5ff5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.756274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1041/2114] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:11.760709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:11.775226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9236e7-ff2f-48d8-8480-55c05512814f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:11.781468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:11.782624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.782999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.784096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] PATH_INFO: `/v3/projects/735f64db10ff4f0b9c643cf2d4c25fc7/users/94497c8fabcc4171b631ff716586f34a/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.813590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=735f64db10ff4f0b9c643cf2d4c25fc7, user_id=94497c8fabcc4171b631ff716586f34a, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:11.816373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:11.831893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1074/2115] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:11 2022] PUT /identity/v3/projects/735f64db10ff4f0b9c643cf2d4c25fc7/users/94497c8fabcc4171b631ff716586f34a/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:11.842433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:11.843233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:11.843802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:11.879233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] MFA Rules not processed for user `94497c8fabcc4171b631ff716586f34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:11.880518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:11.953963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1042/2116] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:11.958632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.025434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b821-cdda-416c-9914-2cb59f210c8d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.031123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.031792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.032241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.032384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.033097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.035053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.071931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1075/2117] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:40:11 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:12.073148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.083892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d64b-6c3e-4f9d-80d8-0fdc92bac610 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.146890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.147576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.147890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.148171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.148877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.150867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.177764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1043/2118] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:40:12 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:40:12.178865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.199047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b7817-4554-4c3d-84cd-aec79ab49808 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.207179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.207903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.208276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.208560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.210759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.213275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.228881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1076/2119] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:40:12.233157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.251434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf288f-c6b9-45aa-8ab4-23c8dcfbf072 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.259432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.263274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.263851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.264372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] PATH_INFO: `/v3/projects/986dc45fd85047489aa4c6de5c096a84/users/0750b74dcedd4f57ab59b013f38dada2/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.298402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=986dc45fd85047489aa4c6de5c096a84, user_id=0750b74dcedd4f57ab59b013f38dada2, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.301372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.320818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1044/2120] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:12 2022] PUT /identity/v3/projects/986dc45fd85047489aa4c6de5c096a84/users/0750b74dcedd4f57ab59b013f38dada2/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:12.324869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.336500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208adc2-df29-42c0-a047-48b9713ea888 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.358887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:12.408932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33537-dab6-4073-b931-9c2ffae550e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.409605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33537-dab6-4073-b931-9c2ffae550e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.409895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33537-dab6-4073-b931-9c2ffae550e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.410170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33537-dab6-4073-b931-9c2ffae550e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.411884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a33537-dab6-4073-b931-9c2ffae550e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.423098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a33537-dab6-4073-b931-9c2ffae550e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.436787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1077/2121] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:12.438473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.448896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:12.461088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d47fd-6b02-48dc-b949-b2022e447d6d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.466162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.467278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.467705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.470393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] PATH_INFO: `/v3/projects/986dc45fd85047489aa4c6de5c096a84/users/0750b74dcedd4f57ab59b013f38dada2/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.472465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986dc45fd85047489aa4c6de5c096a84, user_id=0750b74dcedd4f57ab59b013f38dada2, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.474752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.486064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1045/2122] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:12 2022] PUT /identity/v3/projects/986dc45fd85047489aa4c6de5c096a84/users/0750b74dcedd4f57ab59b013f38dada2/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:12.496243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.496544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.496833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.541350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] MFA Rules not processed for user `0750b74dcedd4f57ab59b013f38dada2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:12.542781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:12.647885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1078/2123] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:12.659714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:12.664914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:12.742271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e7849-2b66-4d72-bd84-da3cfec82d87 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:12.748251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a09fd-ca93-408a-8953-6a4c2a630106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:12.749483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a09fd-ca93-408a-8953-6a4c2a630106 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:12.749778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a09fd-ca93-408a-8953-6a4c2a630106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:12.750055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a09fd-ca93-408a-8953-6a4c2a630106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:12.818654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a09fd-ca93-408a-8953-6a4c2a630106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:12.820177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a09fd-ca93-408a-8953-6a4c2a630106 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:12.831583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1046/2124] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:14.462600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:14.464090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:14.539493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05944a12-90a2-405e-9ece-42b0dcc88df2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:14.544552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:14.545509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:14.546390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:14.546665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] PATH_INFO: `/v3/users/eb05cb47efb44f0382b5fef01ee0a780` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:14.548115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb05cb47efb44f0382b5fef01ee0a780)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:14.550097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:14.601875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb05cb47efb44f0382b5fef01ee0a780'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:14.603759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:14.620054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb05cb47efb44f0382b5fef01ee0a780'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:14.628381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb05cb47efb44f0382b5fef01ee0a780'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:14.629131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb05cb47efb44f0382b5fef01ee0a780'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:14.637218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb05cb47efb44f0382b5fef01ee0a780'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:14.644727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1079/2125] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:40:14 2022] DELETE /identity/v3/users/eb05cb47efb44f0382b5fef01ee0a780 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:14.649337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07817-1937-4970-849d-a5abe2281eee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:14.649827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07817-1937-4970-849d-a5abe2281eee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:14.650097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07817-1937-4970-849d-a5abe2281eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:14.671632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b3a07817-1937-4970-849d-a5abe2281eee None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:14.672884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b3a07817-1937-4970-849d-a5abe2281eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:14.737314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1047/2126] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:14.751201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:14.753182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:14.810618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095444b3-a2b0-4163-9fb6-a124bbac94ef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:14.815348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:14.816034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:14.816324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:14.816681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:14.825808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:14.827457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:14.837016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1080/2127] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:14.961090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913e0c-3dce-496f-889e-e4f42ba6e22b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:14.961386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913e0c-3dce-496f-889e-e4f42ba6e22b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:14.961669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913e0c-3dce-496f-889e-e4f42ba6e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:14.980565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c5913e0c-3dce-496f-889e-e4f42ba6e22b None None] MFA Rules not processed for user `e671d76c5e5b4d528310abedb603d16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:14.981764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c5913e0c-3dce-496f-889e-e4f42ba6e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.032717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:15.055948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1048/2128] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:15.188803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.190334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.227227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c04a4-955f-4c58-83d9-ee6e859eb06f service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.234457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.235418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.235727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.236331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] PATH_INFO: `/v3/projects/79a60c2a91f9450ca42ed5166683700c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.237269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a60c2a91f9450ca42ed5166683700c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.239221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.289390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a60c2a91f9450ca42ed5166683700c', 'request_id': 'req-6797c84b-65bb-4de7-b32a-ed06e3d8119d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.295511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a60c2a91f9450ca42ed5166683700c', 'request_id': 'req-6797c84b-65bb-4de7-b32a-ed06e3d8119d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.301949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a60c2a91f9450ca42ed5166683700c', 'request_id': 'req-6797c84b-65bb-4de7-b32a-ed06e3d8119d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.316805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] The token cache is being invalidate because project 79a60c2a91f9450ca42ed5166683700c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:40:15.317543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.318648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.320751 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1081/2129] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:40:15 2022] DELETE /identity/v3/projects/79a60c2a91f9450ca42ed5166683700c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:15.326028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc639-4879-4bdc-bc7a-c389576682d6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.326329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc639-4879-4bdc-bc7a-c389576682d6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.326615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc639-4879-4bdc-bc7a-c389576682d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.345654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-09dbc639-4879-4bdc-bc7a-c389576682d6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:15.346875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-09dbc639-4879-4bdc-bc7a-c389576682d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.379034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.380873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.423744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1049/2130] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:15.431462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.431756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.432070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.444689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:15.454383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:15.456108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.460040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797c84b-65bb-4de7-b32a-ed06e3d8119d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.465482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436271d2-f302-4373-b086-0585db186881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.466481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436271d2-f302-4373-b086-0585db186881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.466832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436271d2-f302-4373-b086-0585db186881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.467177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436271d2-f302-4373-b086-0585db186881 admin admin] PATH_INFO: `/v3/users/94497c8fabcc4171b631ff716586f34a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.467858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1050/2131] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:15.471407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436271d2-f302-4373-b086-0585db186881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94497c8fabcc4171b631ff716586f34a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.472177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.473625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436271d2-f302-4373-b086-0585db186881 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.483124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a886-b017-418b-a63a-4a72cebd436f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.490414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.491156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.491513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.500237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.501054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:40:15.501679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.503606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.525214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1051/2132] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:40:15.526466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.529881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-436271d2-f302-4373-b086-0585db186881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94497c8fabcc4171b631ff716586f34a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.540265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168226fe-5492-4122-93f4-89213df1394f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.547553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.548250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.548536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.548816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.549523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.549626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-436271d2-f302-4373-b086-0585db186881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94497c8fabcc4171b631ff716586f34a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.551464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.557920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-436271d2-f302-4373-b086-0585db186881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94497c8fabcc4171b631ff716586f34a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.558823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-436271d2-f302-4373-b086-0585db186881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94497c8fabcc4171b631ff716586f34a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.569747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-436271d2-f302-4373-b086-0585db186881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94497c8fabcc4171b631ff716586f34a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:15.577021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1082/2133] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:40:15 2022] DELETE /identity/v3/users/94497c8fabcc4171b631ff716586f34a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:15.582775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1052/2134] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:40:15 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:40:15.583738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.584314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.584767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.585255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.586191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.609456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:15.610776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.678342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebc409-c030-4512-a1ed-0517a2b5fa8b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.684327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.685326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.688084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.688471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.689271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.691321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.701508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1083/2135] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:15.707183 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.712017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.730679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1053/2136] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:40:15 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:15.735262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.755477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afb27d-1e9b-4053-b0a5-27b94c9026f2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.778676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.781946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.782258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.784514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.785331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.792430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.813949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1054/2137] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:15.815208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735611cb-80ed-4b7c-a955-b01dc6abe212 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.816009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.820121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.821115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.821566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.824575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.834230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d48c-ab7b-4f34-94b6-cb6b1a7a6a86 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.840157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.842000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.844855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d55694-7c94-4f6f-9894-f96217377b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.845573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d55694-7c94-4f6f-9894-f96217377b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.845863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d55694-7c94-4f6f-9894-f96217377b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.846146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d55694-7c94-4f6f-9894-f96217377b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.846889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d55694-7c94-4f6f-9894-f96217377b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.848563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d55694-7c94-4f6f-9894-f96217377b85 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.858598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1084/2138] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:15.867783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1055/2139] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:15.871745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:15.885765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aa0c-1a2a-4801-ba31-763674d12924 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:15.892745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:15.894943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.895408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.895915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] PATH_INFO: `/v3/projects/49c7f224d0374125ae22f576e8757f29/users/00cfbc965d934d6db28f41f8082eb5ef/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.911308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:15.918402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c7f224d0374125ae22f576e8757f29, user_id=00cfbc965d934d6db28f41f8082eb5ef, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:15.923483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:15.949452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1085/2140] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:15 2022] PUT /identity/v3/projects/49c7f224d0374125ae22f576e8757f29/users/00cfbc965d934d6db28f41f8082eb5ef/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:15.954483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:15.955189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:15.955564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:15.978697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:15.980067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:15.994583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:16.067867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1056/2141] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:16.082307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:16.172223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7959a0-f4f2-4b3a-90ce-af2766e96003 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:16.177871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:16.177871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:16.178155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:16.178485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:16.191333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:16.201218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:16.204950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:16.205149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1086/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:16.206405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:16.220385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87c5ea-11f7-4518-81b7-3ac5d458cbdc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:16.225250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:16.226112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:16.226393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:16.226665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] PATH_INFO: `/v3/projects/735f64db10ff4f0b9c643cf2d4c25fc7` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:16.228119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] RBAC: Authorizing `identity:delete_project(project_id=735f64db10ff4f0b9c643cf2d4c25fc7)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:16.230065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:16.293244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735f64db10ff4f0b9c643cf2d4c25fc7', 'request_id': 'req-3003abfe-4b32-49ae-9137-9cc11304217b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.300512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735f64db10ff4f0b9c643cf2d4c25fc7', 'request_id': 'req-3003abfe-4b32-49ae-9137-9cc11304217b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.306178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735f64db10ff4f0b9c643cf2d4c25fc7', 'request_id': 'req-3003abfe-4b32-49ae-9137-9cc11304217b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.320008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] The token cache is being invalidate because project 735f64db10ff4f0b9c643cf2d4c25fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:40:16.320451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.321237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.323040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1057/2143] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:40:16 2022] DELETE /identity/v3/projects/735f64db10ff4f0b9c643cf2d4c25fc7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:16.327466 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:16.338001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553570f-1657-4b97-836d-552183ef8cd1 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:16.396952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:16.397966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:16.398090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:16.398360 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] PATH_INFO: `/v3/users/0750b74dcedd4f57ab59b013f38dada2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:16.399679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=0750b74dcedd4f57ab59b013f38dada2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:16.401718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:16.465146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0750b74dcedd4f57ab59b013f38dada2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.479821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0750b74dcedd4f57ab59b013f38dada2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.489842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0750b74dcedd4f57ab59b013f38dada2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.490543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0750b74dcedd4f57ab59b013f38dada2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.497935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73753577-c37a-47e9-af93-1d18f5c68ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0750b74dcedd4f57ab59b013f38dada2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:16.504341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1087/2144] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:40:16 2022] DELETE /identity/v3/users/0750b74dcedd4f57ab59b013f38dada2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:40:16.800461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:16.802405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:16.832682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003abfe-4b32-49ae-9137-9cc11304217b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:16.926981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:16.928070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:16.928991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:16.929504 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] PATH_INFO: `/v3/projects/986dc45fd85047489aa4c6de5c096a84` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:16.942153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986dc45fd85047489aa4c6de5c096a84)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:16.944648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.001596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:17.009643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986dc45fd85047489aa4c6de5c096a84', 'request_id': 'req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:17.017446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986dc45fd85047489aa4c6de5c096a84', 'request_id': 'req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:17.024503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986dc45fd85047489aa4c6de5c096a84', 'request_id': 'req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:17.039645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] The token cache is being invalidate because project 986dc45fd85047489aa4c6de5c096a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:40:17.039972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:17.040609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f8a24b7f-3fc6-43e5-8a6f-b23c359b8a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:17.042186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1058/2145] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:40:16 2022] DELETE /identity/v3/projects/986dc45fd85047489aa4c6de5c096a84 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:17.048365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.048678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.048950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.066979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:17.068232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:17.073787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:17.133859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1088/2146] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:17.142991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.143444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.143806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.164694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:17.165968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:17.176685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1059/2147] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:17.179563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.192148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117627-71be-4e5b-8339-bcef2e0d8d59 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.198109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.198767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.199164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.199458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.200323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:40:17.200713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.203028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.217034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1089/2148] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:40:17.222145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.234324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6aaad-470e-4a42-99b3-2e51d1b5ba1b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.239961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.240928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.241312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.241655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.242482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.244608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.274427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1060/2149] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:40:17 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:17.278425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.289481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a465739-e1dc-4eff-a95a-7a95f7289b84 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.366219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.366913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.367204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.367486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.368273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.370387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.404534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1090/2150] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:40:17 2022] POST /identity/v3/users => generated 282 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:17.406368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.418827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1ea7d-5d72-4f0f-b490-ea9b07dd933b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.425051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.425731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.426174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.426466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.427224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.429134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.440754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1061/2151] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:17.444648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.460310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246172-e3ac-4a5e-a85a-87ac9560d29f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.467585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197cd1b-ba2c-4905-ab35-ead7d22805b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.468530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197cd1b-ba2c-4905-ab35-ead7d22805b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.468825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197cd1b-ba2c-4905-ab35-ead7d22805b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.469113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197cd1b-ba2c-4905-ab35-ead7d22805b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.470580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197cd1b-ba2c-4905-ab35-ead7d22805b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.472589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197cd1b-ba2c-4905-ab35-ead7d22805b8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.491247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1091/2152] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:17.492960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.506355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dcf62-f06d-412d-af6f-c84a418d0d7f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.513943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.516238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.516637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.517016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] PATH_INFO: `/v3/projects/a79ee1f4c2d24e7abbe3f3407fac10db/users/d297182299fc4f4e9d14aaf9f2a09954/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.537491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79ee1f4c2d24e7abbe3f3407fac10db, user_id=d297182299fc4f4e9d14aaf9f2a09954, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.541433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.568162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1062/2153] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:17 2022] PUT /identity/v3/projects/a79ee1f4c2d24e7abbe3f3407fac10db/users/d297182299fc4f4e9d14aaf9f2a09954/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:17.570116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e31716-0c85-452e-8eab-4c977795869e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.571422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e31716-0c85-452e-8eab-4c977795869e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.571809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e31716-0c85-452e-8eab-4c977795869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.610645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d5e31716-0c85-452e-8eab-4c977795869e None None] MFA Rules not processed for user `d297182299fc4f4e9d14aaf9f2a09954`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:17.613441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5e31716-0c85-452e-8eab-4c977795869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:17.712267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1092/2154] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:17.727301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:17.729241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:17.833896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da68b-c3d4-4b02-9b9b-512b1667850b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:17.838542 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:17.839395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:17.839921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:17.840354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:17.852575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:17.854078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:17.876161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1063/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:25.501670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.502151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.502231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:25.515641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:25.532283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] MFA Rules not processed for user `00cfbc965d934d6db28f41f8082eb5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:25.533599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:25.608585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1093/2156] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:25.609773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:25.611272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:25.711478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b6b-d857-4fbe-8707-2fe353404d43 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:25.716893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:25.718605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.719060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.719462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:25.720305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:25.722182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:25.737315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:25.759878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1064/2157] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:40:25 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:25.761488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:25.774405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16227c6b-26a3-41d1-a3f2-7647b0d87b67 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:25.853780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e185910-029c-4c10-aefd-20c5dddb2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:25.854611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e185910-029c-4c10-aefd-20c5dddb2608 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.855361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e185910-029c-4c10-aefd-20c5dddb2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.855770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e185910-029c-4c10-aefd-20c5dddb2608 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:25.856762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e185910-029c-4c10-aefd-20c5dddb2608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:25.859615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e185910-029c-4c10-aefd-20c5dddb2608 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:25.887154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1094/2158] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:40:25 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:40:25.892123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:25.899533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f86a-a095-4e11-b9eb-b1bca1b28896 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.900009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f86a-a095-4e11-b9eb-b1bca1b28896 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.900396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f86a-a095-4e11-b9eb-b1bca1b28896 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:25.902262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1095/2159] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 18:40:25.907511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a67ac7-5da8-4cd6-a8c0-89cfa5183624 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:25.914192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:25.915171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.915466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.915762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:25.916529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:25.919938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.920091 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:25.921561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.921561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:25.955140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1065/2160] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:25.955360 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:25.957063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:25.957184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:25.984036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305924f-534c-4a73-82f3-9bb6cebd0dcd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:25.995235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:25.996835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:25.997127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:25.997412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] PATH_INFO: `/v3/projects/86fcb8e7e5864731966b217aa690ee62/users/e7853811842340f092c47ec883052d01/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:26.064805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fcb8e7e5864731966b217aa690ee62, user_id=e7853811842340f092c47ec883052d01, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:26.082601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:26.125068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1066/2161] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:25 2022] PUT /identity/v3/projects/86fcb8e7e5864731966b217aa690ee62/users/e7853811842340f092c47ec883052d01/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:26.129475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:26.157750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:26.163607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1096/2162] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:40:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:40:26.169169 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:26.208057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66530-c922-4d9f-80c1-3b38e9ab3608 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:26.273281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db260a88-81ce-4bf9-86e0-6610f9a36852 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:26.287674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:26.290550 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:26.292222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:26.294005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:26.294706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] PATH_INFO: `/v3/users/3eae8de1576148ed83eaf66da7971818` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:26.298195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eae8de1576148ed83eaf66da7971818)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:26.300231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:26.364722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:26.365580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:26.366027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:26.366486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:26.367365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:26.372394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:26.402230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eae8de1576148ed83eaf66da7971818'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:26.407972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1097/2163] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:26.409128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:26.423448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:26.453108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eae8de1576148ed83eaf66da7971818'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:26.476355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eae8de1576148ed83eaf66da7971818'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:26.477345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eae8de1576148ed83eaf66da7971818'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:26.478239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eae8de1576148ed83eaf66da7971818'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:26.507226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1067/2164] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:40:26 2022] DELETE /identity/v3/users/3eae8de1576148ed83eaf66da7971818 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:26.508398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:26.509480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:26.613171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:26.639550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381cc0-28af-4c76-ac74-22f752efe38a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:26.646113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451dab6-a2d6-448e-92e0-5e1fa2209045 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:26.662711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:26.664111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:26.665180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:26.665635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] PATH_INFO: `/v3/projects/86fcb8e7e5864731966b217aa690ee62/users/e7853811842340f092c47ec883052d01/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:26.668135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fcb8e7e5864731966b217aa690ee62, user_id=e7853811842340f092c47ec883052d01, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:26.675388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:26.705447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1068/2165] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:26 2022] PUT /identity/v3/projects/86fcb8e7e5864731966b217aa690ee62/users/e7853811842340f092c47ec883052d01/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:26.796176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:26.797249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:26.797944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:26.798697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:26.801180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:26.838312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:26.840140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7405e14-3a78-4cf5-bbc9-540c191a2010 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:26.866634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1098/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:27.042368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:27.048767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:27.198100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274a92-fb6d-4080-99a2-fc49adb1a9da admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:27.211190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:27.214777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.216546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.216961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] PATH_INFO: `/v3/projects/61c31a31afc94f8688241b713ec3e892` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.227233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c31a31afc94f8688241b713ec3e892)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:27.231223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:27.313109 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c31a31afc94f8688241b713ec3e892', 'request_id': 'req-c022e63c-ea82-45ae-b43e-02ca6493f422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:27.320765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c31a31afc94f8688241b713ec3e892', 'request_id': 'req-c022e63c-ea82-45ae-b43e-02ca6493f422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:27.328438 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c31a31afc94f8688241b713ec3e892', 'request_id': 'req-c022e63c-ea82-45ae-b43e-02ca6493f422'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:27.360566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] The token cache is being invalidate because project 61c31a31afc94f8688241b713ec3e892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:40:27.360897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:27.361665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c022e63c-ea82-45ae-b43e-02ca6493f422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:40:27.367880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1069/2167] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:40:27 2022] DELETE /identity/v3/projects/61c31a31afc94f8688241b713ec3e892 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:27.372291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.372827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.373284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.398676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:27.400922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:27.485142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:27.505174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1099/2168] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:27.514569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.515153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.515652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.579728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:27.582682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:27.599088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1070/2169] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:27.603478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:27.617281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223fbd8-5a1e-4f68-a329-bdef54ef81ab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:27.628753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:27.630035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.630484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.630923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.632123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:40:27.632447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:27.634327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:27.664622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1100/2170] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:40:27.665219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:27.684330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc6cbf-ad5e-4ae4-8268-788bc62c4be4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:27.691545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:27.692344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.692771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.693177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.693903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:27.695876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:27.740040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1071/2171] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:40:27 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:40:27.743686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:27.762425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22598882-2c78-492a-9491-c18d38706809 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:27.873948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:27.879584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.879893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.880180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.880908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:27.886303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:27.925135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1101/2172] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:40:27 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:40:27.929268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:27.944117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3287f7-da88-4985-bd21-3dc089dba6d7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:27.949630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:27.950657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:27.951534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:27.952282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:27.953698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:27.955701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:27.985586 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1072/2173] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:27.987124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:27.997461 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5caf4-890f-4fa9-8926-949ae343a182 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:28.018893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734620-3612-4c0d-8b4c-06a8e19993e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:28.019765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734620-3612-4c0d-8b4c-06a8e19993e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:28.020131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734620-3612-4c0d-8b4c-06a8e19993e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:28.020414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734620-3612-4c0d-8b4c-06a8e19993e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:28.021160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734620-3612-4c0d-8b4c-06a8e19993e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:28.023299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734620-3612-4c0d-8b4c-06a8e19993e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:28.041142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1102/2174] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:40:28.045943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:28.056601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26367855-2f91-45c1-954b-7529a122c070 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:28.081265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:28.082174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:28.082761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:28.083050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] PATH_INFO: `/v3/projects/28351bd81f5f497a829c67c15bbb2f09/users/bfa74308096d40daac0a67c9ebec8d8d/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:28.114168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28351bd81f5f497a829c67c15bbb2f09, user_id=bfa74308096d40daac0a67c9ebec8d8d, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:28.117396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:28.136152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:28.151222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1073/2175] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:40:28 2022] PUT /identity/v3/projects/28351bd81f5f497a829c67c15bbb2f09/users/bfa74308096d40daac0a67c9ebec8d8d/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:40:28.152921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f604-32b9-406c-b456-c64fa83c04bc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:28.153296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f604-32b9-406c-b456-c64fa83c04bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:28.153849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f604-32b9-406c-b456-c64fa83c04bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:28.188884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dec5f604-32b9-406c-b456-c64fa83c04bc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:28.190425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dec5f604-32b9-406c-b456-c64fa83c04bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:28.353763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1103/2176] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:28.371825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:28.371825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:28.446702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c3e2c-c967-438c-94ab-9ede4e6fe7b2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:28.451366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:28.452936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:28.453295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:28.453649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:28.466196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:28.469473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:28.483309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1074/2177] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:34.868692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319c57-beef-40e7-9231-888eb91357fa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:34.871300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319c57-beef-40e7-9231-888eb91357fa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:34.873593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319c57-beef-40e7-9231-888eb91357fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:35.007732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d7319c57-beef-40e7-9231-888eb91357fa None None] MFA Rules not processed for user `e7853811842340f092c47ec883052d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:35.009615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d7319c57-beef-40e7-9231-888eb91357fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:35.180513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:35.384164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1104/2178] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:35.445531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:35.447108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:35.652845 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf802-f503-4b33-8887-b11b25f24f56 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:35.665359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:35.666093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:35.666803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:35.667216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:35.669445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:35.743601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:35.745646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:35.750288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:35.777684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1075/2179] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:36.988693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52281207-860f-4483-badc-81c44c299fd5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:36.989156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52281207-860f-4483-badc-81c44c299fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:36.991696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52281207-860f-4483-badc-81c44c299fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:37.038609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-52281207-860f-4483-badc-81c44c299fd5 None None] MFA Rules not processed for user `bfa74308096d40daac0a67c9ebec8d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:37.041335 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52281207-860f-4483-badc-81c44c299fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:37.142615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1105/2180] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:37.158665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:37.170493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdddd9-5f77-4511-bf95-b81ee1413217 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:37.178160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:37.178874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:37.179162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:37.179439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:37.188371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:37.190185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:37.199673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1076/2181] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:40:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:40:37.979359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78ac8-e8fe-4579-8bb5-bda61bd605a6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:37.979359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78ac8-e8fe-4579-8bb5-bda61bd605a6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:37.979359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78ac8-e8fe-4579-8bb5-bda61bd605a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:38.030979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3aa78ac8-e8fe-4579-8bb5-bda61bd605a6 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:38.037452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3aa78ac8-e8fe-4579-8bb5-bda61bd605a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:38.292146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1106/2182] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:40:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:38.375533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:38.378687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:38.562588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83731b-d611-44e0-b089-00a72681a5ac service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:38.580051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fd4e0-2794-49a5-8086-df2d3dd1b895 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:38.582380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fd4e0-2794-49a5-8086-df2d3dd1b895 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:38.582834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fd4e0-2794-49a5-8086-df2d3dd1b895 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:38.583041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fd4e0-2794-49a5-8086-df2d3dd1b895 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:38.606171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fd4e0-2794-49a5-8086-df2d3dd1b895 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:38.609686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fd4e0-2794-49a5-8086-df2d3dd1b895 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:38.622410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1077/2183] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:40:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:40.302131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:40.302698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:40.302698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:40.330617 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] MFA Rules not processed for user `bfa74308096d40daac0a67c9ebec8d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:40.331986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:40.351250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1107/2184] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:40:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:48.616257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=39 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:50.321958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:54.364285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa2002-2737-4a2f-81db-29320b7d7992 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:54.364851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa2002-2737-4a2f-81db-29320b7d7992 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:54.364954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa2002-2737-4a2f-81db-29320b7d7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:54.393669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-74fa2002-2737-4a2f-81db-29320b7d7992 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:54.394976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-74fa2002-2737-4a2f-81db-29320b7d7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:54.409410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1078/2185] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:54.422946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:54.434635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21ebb9-8eee-4fcb-a395-86d6d8dd3a4e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:54.439700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:54.440379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:54.440661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:54.440935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:54.449304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:54.451506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:54.461072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1108/2186] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:54.698653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633916d-c630-445d-b5e7-99abcb039022 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:54.698949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633916d-c630-445d-b5e7-99abcb039022 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:54.699231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633916d-c630-445d-b5e7-99abcb039022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:54.718919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f633916d-c630-445d-b5e7-99abcb039022 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:54.720364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f633916d-c630-445d-b5e7-99abcb039022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:54.729387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1079/2187] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:54.745631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:54.765938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895046-f305-4597-81a0-4866a69b6534 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:54.772864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:54.773725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:54.774105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:54.774601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:54.785625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:54.787243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:54.796803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1109/2188] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 18:40:55.167284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a7543-dbc0-4d9d-aa85-5d6581bc6688 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:55.167576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a7543-dbc0-4d9d-aa85-5d6581bc6688 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:55.167872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a7543-dbc0-4d9d-aa85-5d6581bc6688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:55.185552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-248a7543-dbc0-4d9d-aa85-5d6581bc6688 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:40:55.186890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-248a7543-dbc0-4d9d-aa85-5d6581bc6688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:40:55.193833 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1080/2189] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:40:55.206062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:40:55.217716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa8de2-fdc5-40f8-872f-f7d14f800543 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:40:55.223022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:40:55.223739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:40:55.224236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:40:55.224518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:40:55.233646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:40:55.235237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:40:55.248634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1110/2190] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:41:05.180210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=16 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:05.239993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=18 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:05.280318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:05.280615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:05.280899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:05.298989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:05.300218 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:05.307720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1081/2191] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:41:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:05.319274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:05.329956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4af9d-9c49-45d4-b270-a65017d939b1 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:05.334940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63316957-713b-411b-9f96-938d06a22496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:05.335569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63316957-713b-411b-9f96-938d06a22496 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:05.335888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63316957-713b-411b-9f96-938d06a22496 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:05.336172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63316957-713b-411b-9f96-938d06a22496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:05.344800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63316957-713b-411b-9f96-938d06a22496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:05.346386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63316957-713b-411b-9f96-938d06a22496 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:05.354243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1111/2192] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:41:06.006112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:06.007906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:06.102543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23133cc0-5c92-4d99-ad1f-38a9cb2c4ee6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:06.108835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:06.109605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:06.110002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:06.110688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:06.112629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:06.125433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:06.127243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145f284-67a5-4215-9632-caabeed6460c service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:06.140954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1082/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:41:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:41:06.835300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63316957-713b-411b-9f96-938d06a22496 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:06.836768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-63316957-713b-411b-9f96-938d06a22496 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:06.925445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63316957-713b-411b-9f96-938d06a22496 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:06.930574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:06.931692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:06.932209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:06.932850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] PATH_INFO: `/v3/users/1fcb1a1d12c543378d9405606ad84523` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:06.934325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcb1a1d12c543378d9405606ad84523)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:06.937655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:07.047269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcb1a1d12c543378d9405606ad84523'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.062388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcb1a1d12c543378d9405606ad84523'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.072296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcb1a1d12c543378d9405606ad84523'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.075918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcb1a1d12c543378d9405606ad84523'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.086389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcb1a1d12c543378d9405606ad84523'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.093285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1112/2194] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:41:06 2022] DELETE /identity/v3/users/1fcb1a1d12c543378d9405606ad84523 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:07.099562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:07.101715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:07.102824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:07.152916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:07.154742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:07.236156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1083/2195] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:07.250784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:07.252361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:07.369798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61f9af-5aad-455c-9a7e-43010d905be5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:07.373667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886713b8-fd50-471f-a33c-24bdeee1cea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:07.374315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886713b8-fd50-471f-a33c-24bdeee1cea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:07.374600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886713b8-fd50-471f-a33c-24bdeee1cea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:07.374881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886713b8-fd50-471f-a33c-24bdeee1cea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:07.385953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886713b8-fd50-471f-a33c-24bdeee1cea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:07.386717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886713b8-fd50-471f-a33c-24bdeee1cea8 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:07.400054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1113/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:41:07.636366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:07.639245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:07.665199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb49a4-cf0f-435b-8b84-8531ae427f2b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:07.690103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:07.693794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:07.694347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:07.694891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] PATH_INFO: `/v3/projects/f7201f0c6ab64901a15c6b8588a8f3fd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:07.696750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7201f0c6ab64901a15c6b8588a8f3fd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:07.699215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:07.757633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'request_id': 'req-aa75bf9b-7bb0-4779-816a-6655e426a4c6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.760391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:07.765902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'request_id': 'req-aa75bf9b-7bb0-4779-816a-6655e426a4c6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.783292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'request_id': 'req-aa75bf9b-7bb0-4779-816a-6655e426a4c6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.814759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] The token cache is being invalidate because project f7201f0c6ab64901a15c6b8588a8f3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:41:07.815464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.820195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa75bf9b-7bb0-4779-816a-6655e426a4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:07.822359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1084/2197] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:41:07 2022] DELETE /identity/v3/projects/f7201f0c6ab64901a15c6b8588a8f3fd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:17.392376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:17.797934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=5,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:20.326898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:20.327452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:20.327452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:20.349279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] MFA Rules not processed for user `94d5713dc97f442f916b22d925c35042`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:20.350642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:20.414487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1114/2198] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:23.037474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305448-88d1-4cd6-a4dd-7be894460780 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:23.037941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305448-88d1-4cd6-a4dd-7be894460780 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:23.038043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305448-88d1-4cd6-a4dd-7be894460780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:23.101925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-87305448-88d1-4cd6-a4dd-7be894460780 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:23.103795 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-87305448-88d1-4cd6-a4dd-7be894460780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:23.190830 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1085/2199] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:23.204761 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:23.207036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:23.327088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b6e37-dc29-42c0-b715-846c2f462045 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:23.335413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:23.336298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:23.336742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:23.337036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:23.348083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:23.350008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:23.360221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1115/2200] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:41:24.279372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:24.279899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:24.280022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:24.298533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] MFA Rules not processed for user `00cfbc965d934d6db28f41f8082eb5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:24.299757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:24.366155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1086/2201] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:25.946377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:25.948464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:26.042917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e655b5-d398-4b1d-a15f-e697a5647df9 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:26.051645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:26.052871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.053392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.053873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] PATH_INFO: `/v3/users/e671d76c5e5b4d528310abedb603d16d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.055509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e671d76c5e5b4d528310abedb603d16d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:26.058031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:26.081121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:26.140487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e671d76c5e5b4d528310abedb603d16d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.158686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e671d76c5e5b4d528310abedb603d16d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.170998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e671d76c5e5b4d528310abedb603d16d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.172218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e671d76c5e5b4d528310abedb603d16d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.183512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-02685dc6-f8e5-4685-a722-f16186856bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e671d76c5e5b4d528310abedb603d16d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.195542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1116/2202] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:41:25 2022] DELETE /identity/v3/users/e671d76c5e5b4d528310abedb603d16d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:26.400114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:26.415147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f478881-2049-4457-a9e6-55171007f6a5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:26.479947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:26.481371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.481648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.481924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] PATH_INFO: `/v3/projects/ffb5e6607fb843bca3fb4a6ae694d47e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.483149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb5e6607fb843bca3fb4a6ae694d47e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:26.485186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:26.506606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:26.531370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'request_id': 'req-8eabc519-8c4b-48b9-87b6-1d5812aa252a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.537399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'request_id': 'req-8eabc519-8c4b-48b9-87b6-1d5812aa252a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.542769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'request_id': 'req-8eabc519-8c4b-48b9-87b6-1d5812aa252a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.557097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] The token cache is being invalidate because project ffb5e6607fb843bca3fb4a6ae694d47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:41:26.557391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.558004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8eabc519-8c4b-48b9-87b6-1d5812aa252a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:26.562922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1087/2203] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:41:26 2022] DELETE /identity/v3/projects/ffb5e6607fb843bca3fb4a6ae694d47e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:26.564550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.564852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.565139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.612698 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:26.613905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:26.679094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1117/2204] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:26.686555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.686849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.687132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.705790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:26.706992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:26.715740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1088/2205] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:26.720350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:26.730021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bed37-6ef3-453a-84f3-0c7453722e5b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:26.736413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:26.738369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.738662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.738944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.739697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:41:26.741942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:26.743666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:26.770243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1118/2206] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:41:26.773384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:26.784901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7868-0a2a-4fdd-8763-13fe2fc28456 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:26.790326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:26.791085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.791450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.791793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.792594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:26.796003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:26.828758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1089/2207] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:41:26 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:41:26.832661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:26.846267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31a9a-12e5-44c5-bbdb-847f65a125b7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:26.913647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:26.922107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:26.923100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.923906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.924257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.925478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:26.927725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:26.951964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1119/2208] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:41:26 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:41:26.953598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:26.964059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f5e-1492-4842-8901-9367be858a98 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:26.969866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:26.970525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:26.970810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:26.971088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:26.971821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:26.973456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:26.984142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1090/2209] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:41:26.988215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:27.001032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aa2c5-6270-495a-a69c-6efd89acd3a9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:27.005792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5341a-4db1-42c9-acbf-11361e9b6e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:27.006719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5341a-4db1-42c9-acbf-11361e9b6e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:27.007004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5341a-4db1-42c9-acbf-11361e9b6e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:27.007713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5341a-4db1-42c9-acbf-11361e9b6e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:27.008535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5341a-4db1-42c9-acbf-11361e9b6e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:27.010181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5341a-4db1-42c9-acbf-11361e9b6e05 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:27.022292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1120/2210] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:41:27.026725 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:27.039096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad038-b79e-40b3-9fb3-7fdb943052f5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:27.044117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:27.045179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:27.045485 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:27.045750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] PATH_INFO: `/v3/projects/62e13d9a1def4f948b3cfff4ee9bcaa6/users/9f0db30f9a694ed8b9df216484c5e147/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:27.062206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e13d9a1def4f948b3cfff4ee9bcaa6, user_id=9f0db30f9a694ed8b9df216484c5e147, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:27.065045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:27.080199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1091/2211] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:41:27 2022] PUT /identity/v3/projects/62e13d9a1def4f948b3cfff4ee9bcaa6/users/9f0db30f9a694ed8b9df216484c5e147/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:27.090769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:27.091056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:27.091336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:27.120018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] MFA Rules not processed for user `9f0db30f9a694ed8b9df216484c5e147`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:27.122287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:27.189972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1121/2212] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:27.201367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:27.203125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:27.333988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95534b-4679-4e63-92b0-354824aa096e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:27.338693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996077d8-8445-4d29-85ad-ad054d8e45e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:27.339527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996077d8-8445-4d29-85ad-ad054d8e45e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:27.341691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996077d8-8445-4d29-85ad-ad054d8e45e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:27.342144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996077d8-8445-4d29-85ad-ad054d8e45e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:27.357878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996077d8-8445-4d29-85ad-ad054d8e45e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:27.359999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996077d8-8445-4d29-85ad-ad054d8e45e3 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:27.374875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1092/2213] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:41:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:41:28.415389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:28.416924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:28.510000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9a25-5c83-4af9-a23b-7f1b6a57b504 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:28.518339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:28.519720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:28.520042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:28.520636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] PATH_INFO: `/v3/users/d297182299fc4f4e9d14aaf9f2a09954` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:28.522047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d297182299fc4f4e9d14aaf9f2a09954)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:28.530387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:28.591646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd297182299fc4f4e9d14aaf9f2a09954'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:28.603408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd297182299fc4f4e9d14aaf9f2a09954'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:28.606577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:28.613400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd297182299fc4f4e9d14aaf9f2a09954'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:28.615067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd297182299fc4f4e9d14aaf9f2a09954'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:28.624147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd297182299fc4f4e9d14aaf9f2a09954'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:28.630412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1122/2214] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:41:28 2022] DELETE /identity/v3/users/d297182299fc4f4e9d14aaf9f2a09954 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:28.635119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:28.635584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:28.635705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:28.656376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:28.657610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:28.678224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:28.721448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1093/2215] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:28.731108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:28.732528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:28.801175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09978-69da-459c-b5c8-abcc1c658c95 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:28.803991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:28.804650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:28.805205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:28.805631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:28.816622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:28.818476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:28.830913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1123/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:41:29.632286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:29.639280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:29.657705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934698f-6369-4e49-a5d9-ea45a1a58d33 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:29.665739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:29.666667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:29.666955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:29.667322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] PATH_INFO: `/v3/projects/a79ee1f4c2d24e7abbe3f3407fac10db` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:29.668854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79ee1f4c2d24e7abbe3f3407fac10db)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:29.670683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:29.733450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79ee1f4c2d24e7abbe3f3407fac10db', 'request_id': 'req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:29.741793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79ee1f4c2d24e7abbe3f3407fac10db', 'request_id': 'req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:29.748826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79ee1f4c2d24e7abbe3f3407fac10db', 'request_id': 'req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:29.789523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] The token cache is being invalidate because project a79ee1f4c2d24e7abbe3f3407fac10db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:41:29.789930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:29.791007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1f19fcbf-dfb5-4fc6-a222-a580bc24bbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:29.800771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1094/2217] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:41:29 2022] DELETE /identity/v3/projects/a79ee1f4c2d24e7abbe3f3407fac10db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:37.671115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:37.672590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:37.686473 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd9bb9-2770-42be-8eb2-64a7e0dd33e9 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:37.753841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:37.753841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:37.753841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:37.753841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] PATH_INFO: `/v3/users/9f0db30f9a694ed8b9df216484c5e147` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:37.754277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0db30f9a694ed8b9df216484c5e147)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:37.755544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:37.813260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0db30f9a694ed8b9df216484c5e147'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:37.827749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0db30f9a694ed8b9df216484c5e147'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:37.836808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0db30f9a694ed8b9df216484c5e147'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:37.837555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0db30f9a694ed8b9df216484c5e147'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:37.845606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0db30f9a694ed8b9df216484c5e147'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:37.852049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1124/2218] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:41:37 2022] DELETE /identity/v3/users/9f0db30f9a694ed8b9df216484c5e147 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:37.857261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:37.857736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:37.857816 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:37.875956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:41:37.877177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:37.939529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1095/2219] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:41:37.949151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:37.951286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:37.961645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:38.013315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e170a-11df-4d05-bc5d-90a26aa81eb3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:38.017203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:38.017868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:38.018156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:38.018447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:38.029025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:38.030508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:38.041182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1125/2220] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:41:38.323155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:38.325090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:38.339973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3028a54-3cd1-4fab-9ed5-894e5c64b6d6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:38.345733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:38.346619 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:38.346879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:38.347160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] PATH_INFO: `/v3/projects/62e13d9a1def4f948b3cfff4ee9bcaa6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:38.348404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e13d9a1def4f948b3cfff4ee9bcaa6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:38.350336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:38.394812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:38.398042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e13d9a1def4f948b3cfff4ee9bcaa6', 'request_id': 'req-be636f4c-9f1e-48b2-a355-d0e2017110bc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:38.410388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e13d9a1def4f948b3cfff4ee9bcaa6', 'request_id': 'req-be636f4c-9f1e-48b2-a355-d0e2017110bc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:38.415971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e13d9a1def4f948b3cfff4ee9bcaa6', 'request_id': 'req-be636f4c-9f1e-48b2-a355-d0e2017110bc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:38.428812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] The token cache is being invalidate because project 62e13d9a1def4f948b3cfff4ee9bcaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:41:38.429103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:38.429713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-be636f4c-9f1e-48b2-a355-d0e2017110bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:41:38.431246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1096/2221] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:41:38 2022] DELETE /identity/v3/projects/62e13d9a1def4f948b3cfff4ee9bcaa6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:41:46.026072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:41:46.036884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e895c-0b2d-43d0-ab3f-10c5c8a51856 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:41:46.096979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:41:46.097641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:41:46.097928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:41:46.098208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:41:46.100091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:41:46.166376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:41:46.167749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:41:46.177838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1126/2222] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:41:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:41:48.425906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:56.173594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=73 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:13.286533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e751e8e-40e8-40e9-9060-56cc9402f868 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:13.287023 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e751e8e-40e8-40e9-9060-56cc9402f868 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:13.287451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e751e8e-40e8-40e9-9060-56cc9402f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:13.309699 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7e751e8e-40e8-40e9-9060-56cc9402f868 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:42:13.311139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e751e8e-40e8-40e9-9060-56cc9402f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:13.376604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1097/2223] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:42:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:42:13.399460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:13.400957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:13.469049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b7130-3bc3-4325-9896-7da7fd37d3da service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:13.474056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9f19d-9f85-4834-ab3a-b651ca3da583 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:13.474706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9f19d-9f85-4834-ab3a-b651ca3da583 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:13.474996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9f19d-9f85-4834-ab3a-b651ca3da583 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:13.475272 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9f19d-9f85-4834-ab3a-b651ca3da583 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:13.483301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9f19d-9f85-4834-ab3a-b651ca3da583 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:13.484934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9f19d-9f85-4834-ab3a-b651ca3da583 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:13.492777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1127/2224] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:42:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:42:23.365072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=25 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:23.489748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=32 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:29.376430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b089-f176-4e6e-b7ed-0d21bd730b0d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.377031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b089-f176-4e6e-b7ed-0d21bd730b0d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.377238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b089-f176-4e6e-b7ed-0d21bd730b0d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.378743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1098/2225] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:42:29.384803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e15d9-ca69-4d29-afde-6cc0d650a7a3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.385291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e15d9-ca69-4d29-afde-6cc0d650a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.385382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e15d9-ca69-4d29-afde-6cc0d650a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.435883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-982e15d9-ca69-4d29-afde-6cc0d650a7a3 None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:42:29.437102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-982e15d9-ca69-4d29-afde-6cc0d650a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:29.524393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1128/2226] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:42:29.536399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b089-f176-4e6e-b7ed-0d21bd730b0d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:29.538084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fc93b089-f176-4e6e-b7ed-0d21bd730b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:29.619210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b089-f176-4e6e-b7ed-0d21bd730b0d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:29.623019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a46340-0517-4be9-8e54-db2c978a6e52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:29.623661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a46340-0517-4be9-8e54-db2c978a6e52 service glance] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.623982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a46340-0517-4be9-8e54-db2c978a6e52 service glance] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.624265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a46340-0517-4be9-8e54-db2c978a6e52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.634354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a46340-0517-4be9-8e54-db2c978a6e52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:29.635788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a46340-0517-4be9-8e54-db2c978a6e52 service glance] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:29.647055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1099/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:42:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:42:29.721398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6964cb1-663f-4608-bf34-d46f908afc0c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.721690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6964cb1-663f-4608-bf34-d46f908afc0c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.721976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6964cb1-663f-4608-bf34-d46f908afc0c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.723399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1129/2228] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:42:29.728197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4670-b536-4b28-9289-43e3ef6c32d5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.728495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4670-b536-4b28-9289-43e3ef6c32d5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.728799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4670-b536-4b28-9289-43e3ef6c32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.748021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-01ce4670-b536-4b28-9289-43e3ef6c32d5 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:42:29.749237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-01ce4670-b536-4b28-9289-43e3ef6c32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:29.756147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1100/2229] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:42:29.768018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6964cb1-663f-4608-bf34-d46f908afc0c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:29.769824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e6964cb1-663f-4608-bf34-d46f908afc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:29.783063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6964cb1-663f-4608-bf34-d46f908afc0c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:29.786575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f15823-c162-41f3-b388-b7ee3de080de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:29.787214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f15823-c162-41f3-b388-b7ee3de080de service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.787530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f15823-c162-41f3-b388-b7ee3de080de service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.787810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f15823-c162-41f3-b388-b7ee3de080de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.795062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f15823-c162-41f3-b388-b7ee3de080de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:29.796538 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f15823-c162-41f3-b388-b7ee3de080de service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:29.804525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1130/2230] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:42:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:42:29.893383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2039a-d203-4416-b85e-4964cef27169 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.893674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2039a-d203-4416-b85e-4964cef27169 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.893954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2039a-d203-4416-b85e-4964cef27169 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.895395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1101/2231] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:42:29.900865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fed44-9e9c-4d8f-94bc-92800e33b73e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.901158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fed44-9e9c-4d8f-94bc-92800e33b73e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.901440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fed44-9e9c-4d8f-94bc-92800e33b73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.920174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aa4fed44-9e9c-4d8f-94bc-92800e33b73e None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:42:29.921362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aa4fed44-9e9c-4d8f-94bc-92800e33b73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:29.930421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1131/2232] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:42:29.941446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2039a-d203-4416-b85e-4964cef27169 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:29.953350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2039a-d203-4416-b85e-4964cef27169 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:29.956975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:29.957605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:29.957891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:29.958169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:29.968587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:29.970024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:29.980927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1102/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:42:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:42:32.368282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:32.368740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:32.368869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:32.386861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:42:32.388077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:32.395097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1132/2234] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:42:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:42:32.406687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:32.418645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95dfd-2878-49d0-ae0f-82e8ec661481 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:32.423518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:32.424173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:32.424458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:32.424734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:32.432649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:32.434956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:32.443000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1103/2235] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:42:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:42:42.381901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=58 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:42.439855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=50 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:48.322572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:48.332150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e821e5-7f4b-4bb2-9145-f455cd62fd5d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:48.335621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:48.336294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:48.336576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:48.336845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:48.338586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:48.352006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:48.353430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e9976-987b-4d30-9b3a-f29a881bab38 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:48.364064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1133/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:42:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:42:49.489424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:49.490915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:49.502972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505271b-9584-440a-8343-51f9354138c8 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:49.506823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:49.507453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:49.507739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:49.508054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:49.509759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:49.523061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:49.524521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:49.535875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1104/2237] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:42:58.359453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:58.545023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:58.545339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:58.545568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:58.563896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:42:58.565080 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:42:58.572942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1134/2238] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:42:58.584810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:42:58.596431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf712b-537c-4065-aa3d-8368c302b596 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:42:58.601393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:42:58.602027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:42:58.602315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:42:58.602595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:42:58.611637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:42:58.613267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:42:58.621217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1105/2239] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 18:43:08.558413 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:08.617991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=12 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:22.537277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:22.538785 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:22.554892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a849035-179b-4de6-aea5-b02efa81d9eb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:22.560813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:22.561453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:22.561741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:22.562023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:22.563753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:22.620542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:22.622261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d82bd-488f-497a-acf0-93d2405aa5be service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:22.631599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1135/2240] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:43:32.627261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=28 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:36.776086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:36.788457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00294d79-61b8-4cd4-8033-c67eec50fcc2 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:36.793733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:36.794387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:36.794669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:36.794939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:36.796836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:36.855777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:36.857421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:36.866515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1106/2241] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:43:38.608974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:38.609472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:38.609588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:38.627033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] MFA Rules not processed for user `bfa74308096d40daac0a67c9ebec8d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:43:38.628204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:38.682683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1136/2242] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:43:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:43:38.998228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:39.008403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58eb84-04bb-472f-aca1-a745a89f7476 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:39.012705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:39.013336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:39.013622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:39.013905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:39.016189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:39.025876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:39.027626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:39.035446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1107/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:43:39.340310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:39.341708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:39.410940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfda25-a027-48df-93bb-cac2e2d237ea None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:39.415958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:39.416609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:39.416922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:39.417222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:39.418999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:39.430322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:39.431962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8944a8-9498-4ced-a061-0ff1ff869a41 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:39.442250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1137/2244] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:43:41.208163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:41.220627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896799d-887c-4199-9551-0e40e0ecdf3d service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:41.226501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:41.227291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:41.227700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:41.228245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:41.231306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:41.248562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:41.250114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:41.260172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1108/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:43:48.518624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:48.519161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:48.519252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:48.539614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] MFA Rules not processed for user `94d5713dc97f442f916b22d925c35042`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:43:48.540816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:48.553621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1138/2246] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:43:51.255333 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=40 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:55.140607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:55.144125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:55.169641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7266-6c36-49ae-8ecf-75dd99a2cf1d service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:55.177640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:55.179350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:55.179949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:55.180520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:55.183794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:55.201562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:55.205466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:55.232053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1109/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:43:56.155563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:43:56.169221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656d31-386e-4894-b3dc-917f8003d3dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:43:56.174696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:43:56.175339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:43:56.175623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:43:56.175931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:43:56.177748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:43:56.190806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:43:56.192431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a904a7-afed-4880-a6d9-68ab73fda2ac service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:43:56.203287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1139/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:43:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:44:05.214601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:06.198592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=66 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:07.376343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:44:07.388044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ea97-545b-4333-8abf-0f67d5a6ca37 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:44:07.394172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:44:07.394746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:44:07.395031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:44:07.395309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:44:07.397122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:44:07.456094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:44:07.457690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:44:07.467711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1110/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:44:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:44:14.610612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:44:14.611158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:44:14.611158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:44:14.629351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] MFA Rules not processed for user `8978ed54252843f78b0d00d37b475ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:44:14.630555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:44:14.637423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1140/2250] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:44:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:44:14.940518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:44:14.949620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560f22f-add8-4ff7-b837-cd38227889c8 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:44:14.954062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:44:14.954694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:44:14.954979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:44:14.955257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:44:14.957037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:44:14.967042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:44:14.968513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f0236-63a8-4af4-bdad-f95473d339e3 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:44:14.976320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1111/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:44:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:44:24.624135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:24.858420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:44:24.871314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c50bd0-c787-40b0-8a28-fdc062515abf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:44:24.876859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:44:24.877451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:44:24.877734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:44:24.878011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:44:24.880059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:44:24.892792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:44:24.894381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74706516-308b-4f56-84f0-e99d896f87b9 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:44:24.905386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1141/2252] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:44:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:44:24.972851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=34 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:31.313670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12313866-6158-4ffe-b782-95992699c245 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:44:31.314213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12313866-6158-4ffe-b782-95992699c245 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:44:31.314213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12313866-6158-4ffe-b782-95992699c245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:44:31.333287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-12313866-6158-4ffe-b782-95992699c245 None None] MFA Rules not processed for user `00cfbc965d934d6db28f41f8082eb5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:44:31.334495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-12313866-6158-4ffe-b782-95992699c245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:44:31.390750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1112/2253] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:44:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:44:34.900504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:41.383960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=25 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:21.517370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:21.517868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:21.517986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:21.536308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] MFA Rules not processed for user `d32582f1a1994e3b9c05f56185d0079d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:21.537422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:21.544477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1142/2254] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:31.531655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:32.483478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12313866-6158-4ffe-b782-95992699c245 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:32.493139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12313866-6158-4ffe-b782-95992699c245 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:32.497356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:32.497994 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:32.498274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:32.498546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:32.500321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:32.562689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:32.564120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:32.574100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1113/2255] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:35.648691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:35.663934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a733e40-237d-4c15-b030-deaca693e7bf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:35.669831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:35.670754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:35.671229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:35.671716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:35.674337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:35.693058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:35.694934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:35.717961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:35.719651 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:35.719969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1143/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:35.739801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c132b-7d72-4ab1-8cf9-44c31fe19fba service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:35.748883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:35.750123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:35.750841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:35.751648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] PATH_INFO: `/v3/users/94d5713dc97f442f916b22d925c35042` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:35.756522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d5713dc97f442f916b22d925c35042)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:35.758598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:35.818869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d5713dc97f442f916b22d925c35042'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:35.837303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d5713dc97f442f916b22d925c35042'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:35.846121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d5713dc97f442f916b22d925c35042'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:35.847022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d5713dc97f442f916b22d925c35042'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:35.847683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-28c319d9-8dc6-4838-8e35-7cfc5b2a93b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d5713dc97f442f916b22d925c35042'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:35.864032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1114/2257] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:45:35 2022] DELETE /identity/v3/users/94d5713dc97f442f916b22d925c35042 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:45:36.051767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.063918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca00-dfe2-4e81-b0a3-b146b92657a1 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.132539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.133769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.134124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.134471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] PATH_INFO: `/v3/projects/d866c4a659e74e42a3c37050eae82229` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.135734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d866c4a659e74e42a3c37050eae82229)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.137998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.186116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd866c4a659e74e42a3c37050eae82229', 'request_id': 'req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:36.192262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd866c4a659e74e42a3c37050eae82229', 'request_id': 'req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:36.197972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd866c4a659e74e42a3c37050eae82229', 'request_id': 'req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:36.210484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] The token cache is being invalidate because project d866c4a659e74e42a3c37050eae82229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:45:36.210714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:36.211329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-41fce5d3-d4ae-4d22-a7b1-d2a76848169f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:36.212931 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1144/2258] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:45:36 2022] DELETE /identity/v3/projects/d866c4a659e74e42a3c37050eae82229 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:36.218448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.218675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.218953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.237011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:36.238227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:36.301373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1115/2259] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:36.309529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.309819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.310099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.327897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:36.329119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:36.337071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1145/2260] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:36.341953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.351860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf408-8f84-4398-829b-ddbd6540beb1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.357999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.358667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.358972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.359243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.360047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:45:36.360364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.361985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.363615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:36.377089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1116/2261] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:45:36.381436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.391222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952e856-9748-4344-8f29-4439b136dbf9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.399244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.399916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.400172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.400455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.401176 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.403995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.459065 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1146/2262] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:45:36 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:36.463261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.475062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4558-acd0-404a-86af-3944090f93be admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.541293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.541972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.542258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.542598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.543388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.545360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.566044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1117/2263] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:45:36 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:36.570359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.581392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0742a-d65c-4fcb-81de-a0bd90ad086f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.586312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.586983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.587271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.587576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.588327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.590305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.600573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1147/2264] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:36.604578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.615179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d214-d6e5-4093-b549-0f4f3331ef41 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.619898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676f09-9bba-425d-aef0-fb7553ae2e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.620560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676f09-9bba-425d-aef0-fb7553ae2e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.621590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676f09-9bba-425d-aef0-fb7553ae2e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.621885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676f09-9bba-425d-aef0-fb7553ae2e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.622766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676f09-9bba-425d-aef0-fb7553ae2e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.624454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676f09-9bba-425d-aef0-fb7553ae2e3b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.634949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1118/2265] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:45:36.639235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.649362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7771cc-07a3-47e8-a4b7-6d8999a5c302 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.655009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.656036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.656330 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.656613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] PATH_INFO: `/v3/projects/c221f960f3a449ad9aca307223c5427f/users/4234ed9d4e4846d996d11de9529b0fc8/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.672336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c221f960f3a449ad9aca307223c5427f, user_id=4234ed9d4e4846d996d11de9529b0fc8, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.675166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.690153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1148/2266] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:36 2022] PUT /identity/v3/projects/c221f960f3a449ad9aca307223c5427f/users/4234ed9d4e4846d996d11de9529b0fc8/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:36.701609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.701984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.702326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.732273 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] MFA Rules not processed for user `4234ed9d4e4846d996d11de9529b0fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:36.733523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:36.805092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1119/2267] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:36.817544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:36.819422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:36.827307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:36.881791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7576729-d29b-42a2-86bd-88b4a0a46f03 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:36.885680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:36.886334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:36.886695 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:36.886973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:36.896300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:36.897769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:36.908648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1149/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:45:38.133113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:38.134588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:38.196704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:38.214897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d3ac1-def7-4667-9bfc-88d6ebc9440d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:38.220515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:38.221114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:38.221404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:38.221685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:38.223453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:38.286921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:38.288957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0e37-76fb-44ea-9379-76d31cce94bc service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:38.299282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1120/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:45.359586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:45.423892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594e32-7b75-4d90-8c0a-097319bf3bd0 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:45.428310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:45.429462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:45.429766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:45.430039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] PATH_INFO: `/v3/users/4234ed9d4e4846d996d11de9529b0fc8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:45.431219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4234ed9d4e4846d996d11de9529b0fc8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:45.433419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:45.480024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4234ed9d4e4846d996d11de9529b0fc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:45.491562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4234ed9d4e4846d996d11de9529b0fc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:45.499007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4234ed9d4e4846d996d11de9529b0fc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:45.499656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4234ed9d4e4846d996d11de9529b0fc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:45.506980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4234ed9d4e4846d996d11de9529b0fc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:45.513866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1150/2270] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:45:45 2022] DELETE /identity/v3/users/4234ed9d4e4846d996d11de9529b0fc8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:45.518862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282459-3d72-4450-a235-4075ea25308d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:45.519944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282459-3d72-4450-a235-4075ea25308d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:45.520234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282459-3d72-4450-a235-4075ea25308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:45.537800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e1282459-3d72-4450-a235-4075ea25308d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:45.539068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e1282459-3d72-4450-a235-4075ea25308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:45.599086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1121/2271] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:45.610493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:45.611969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:45.645494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:45.675037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32b9b-7421-4929-8c39-c857b8e50c94 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:45.679534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17288300-6927-4232-a624-0a2f92bb70aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:45.680361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288300-6927-4232-a624-0a2f92bb70aa service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:45.680668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288300-6927-4232-a624-0a2f92bb70aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:45.680942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288300-6927-4232-a624-0a2f92bb70aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:45.691062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17288300-6927-4232-a624-0a2f92bb70aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:45.692530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17288300-6927-4232-a624-0a2f92bb70aa service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:45.701929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1151/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:45.968632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1282459-3d72-4450-a235-4075ea25308d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:45.970209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e1282459-3d72-4450-a235-4075ea25308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:45.985283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1282459-3d72-4450-a235-4075ea25308d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:45.990585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:45.991581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:45.991966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:45.992314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] PATH_INFO: `/v3/projects/c221f960f3a449ad9aca307223c5427f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:45.994350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c221f960f3a449ad9aca307223c5427f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:45.997020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.049879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c221f960f3a449ad9aca307223c5427f', 'request_id': 'req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:46.056058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c221f960f3a449ad9aca307223c5427f', 'request_id': 'req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:46.061572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c221f960f3a449ad9aca307223c5427f', 'request_id': 'req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:46.076891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] The token cache is being invalidate because project c221f960f3a449ad9aca307223c5427f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:45:46.077187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:46.077854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-cd4f4569-3c83-4f62-94dc-ad97af25d3d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:46.079428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1122/2273] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:45:45 2022] DELETE /identity/v3/projects/c221f960f3a449ad9aca307223c5427f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:46.084541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.084853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.085160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.103647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:46.104988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:46.165722 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1152/2274] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:46.173722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.174018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.174300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.194266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:46.195501 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:46.204294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1123/2275] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:46.208541 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.218932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf89601-ab96-4c14-93f1-95e57d8165cd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.223616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.224331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.224614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.224890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.225623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:45:46.226066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.227715 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.239861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1153/2276] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:45:46.244277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.254841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439a25f-d88d-47a4-beca-ec23be0a1fcb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.259744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.260541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.261434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.261770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.262541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.264599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.278815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:46.296128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1124/2277] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:45:46 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:46.300244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.311585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d1f84-bbad-4083-9617-1a48549fb1a2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.368938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.369588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.369788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.370052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.372054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.373328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.395196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1154/2278] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:45:46 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:46.399119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.410015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855318a8-dcbc-4096-aefd-d95ee476a78b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.414531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.415183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.415465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.415737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.416495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.418953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.429665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1125/2279] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:46.433750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.444504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657975d-aa46-4240-b479-e965ef447253 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.448940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd1b2-c881-4016-a39d-1d30ceacc908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.449604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd1b2-c881-4016-a39d-1d30ceacc908 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.449988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd1b2-c881-4016-a39d-1d30ceacc908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.450156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd1b2-c881-4016-a39d-1d30ceacc908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.450917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd1b2-c881-4016-a39d-1d30ceacc908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.452590 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd1b2-c881-4016-a39d-1d30ceacc908 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.464557 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1155/2280] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:46.467400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.477513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063384b2-21e0-47b3-90e9-4df45d720e79 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.482800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.483708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.484022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.484297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] PATH_INFO: `/v3/projects/af44abf5d6d74f8e8d25c7dbbc9b1aa3/users/a72cb126eed743b5ac18c5fad0d7adc8/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.499153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af44abf5d6d74f8e8d25c7dbbc9b1aa3, user_id=a72cb126eed743b5ac18c5fad0d7adc8, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.502045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.516131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1126/2281] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:46 2022] PUT /identity/v3/projects/af44abf5d6d74f8e8d25c7dbbc9b1aa3/users/a72cb126eed743b5ac18c5fad0d7adc8/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:46.521478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ae4b-fec8-4829-8c3a-378aae451f33 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.521792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ae4b-fec8-4829-8c3a-378aae451f33 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.522080 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ae4b-fec8-4829-8c3a-378aae451f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.541519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1167ae4b-fec8-4829-8c3a-378aae451f33 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:46.542833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1167ae4b-fec8-4829-8c3a-378aae451f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:46.576162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:46.608127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1156/2282] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:46.618742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:46.621290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:46.683411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353453-8699-45d8-8c72-5cae3d41a707 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:46.687195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:46.687947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:46.688297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:46.688642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:46.698973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:46.701050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:46.712473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1127/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:47.462903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:47.463468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:47.463567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:47.508585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] MFA Rules not processed for user `a72cb126eed743b5ac18c5fad0d7adc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:47.509949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:47.599519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1157/2284] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:47.604561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:47.616307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f97e8-0762-4efc-ab7a-3909f2638352 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:47.622201 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:47.623743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:47.624228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:47.624506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:47.625394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:47.627764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:47.661127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1128/2285] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:45:47 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:47.662426 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:47.674626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077238-b9c6-4545-89d0-f6796519f6a7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:47.736602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:47.737283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:47.737572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:47.737852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:47.738549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:47.740621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:47.779802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1158/2286] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:45:47 2022] POST /identity/v3/users => generated 309 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:47.781134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:47.794386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14665cc1-bdbc-41d6-a26e-115d323402d4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:47.800301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:47.800972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:47.801257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:47.801531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:47.802417 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:47.804056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:47.816519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1129/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:47.820648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:47.832072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5945-bf35-49ec-b3b7-6b9a1e0fe376 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:47.837741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:47.838637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:47.839015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:47.839475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] PATH_INFO: `/v3/projects/1e1f09e2b4c14a65b8da2a0a01cd7a11/users/5766397e3d764cb8ae2cac5a6072b98b/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:47.859033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1f09e2b4c14a65b8da2a0a01cd7a11, user_id=5766397e3d764cb8ae2cac5a6072b98b, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:47.861440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:47.879337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1159/2288] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:47 2022] PUT /identity/v3/projects/1e1f09e2b4c14a65b8da2a0a01cd7a11/users/5766397e3d764cb8ae2cac5a6072b98b/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:47.883467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:47.894712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a963-52b0-4b63-9042-5e95e624e02a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:47.981743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dc65e-64f7-458f-a2a1-68eecdf67e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:47.982581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dc65e-64f7-458f-a2a1-68eecdf67e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:47.982872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dc65e-64f7-458f-a2a1-68eecdf67e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:47.983149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dc65e-64f7-458f-a2a1-68eecdf67e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:47.984040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dc65e-64f7-458f-a2a1-68eecdf67e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:47.985708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dc65e-64f7-458f-a2a1-68eecdf67e79 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:47.997774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1130/2289] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:48.001489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:48.013597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3dbc-dd7b-414b-b3f0-3e0a8666c4f2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:48.018942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14416-24ad-4f73-8eb4-c67de79d1026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:48.019818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14416-24ad-4f73-8eb4-c67de79d1026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:48.020145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14416-24ad-4f73-8eb4-c67de79d1026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:48.020425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14416-24ad-4f73-8eb4-c67de79d1026 admin admin] PATH_INFO: `/v3/projects/1e1f09e2b4c14a65b8da2a0a01cd7a11/users/5766397e3d764cb8ae2cac5a6072b98b/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:48.022457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de14416-24ad-4f73-8eb4-c67de79d1026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1f09e2b4c14a65b8da2a0a01cd7a11, user_id=5766397e3d764cb8ae2cac5a6072b98b, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:48.025299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de14416-24ad-4f73-8eb4-c67de79d1026 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:48.039904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1160/2290] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:48 2022] PUT /identity/v3/projects/1e1f09e2b4c14a65b8da2a0a01cd7a11/users/5766397e3d764cb8ae2cac5a6072b98b/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:48.826505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:48.827008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:48.827716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:48.865690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] MFA Rules not processed for user `5766397e3d764cb8ae2cac5a6072b98b`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:48.866985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:48.882909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:48.954595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1131/2291] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:49.972046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:49.972615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:49.972824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:49.991502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] MFA Rules not processed for user `bfa74308096d40daac0a67c9ebec8d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:49.992762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:50.008479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:50.056083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1161/2292] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:50.172048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:50.240402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b379b1-6ab3-4294-a91f-204c92ac219c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:50.246645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:50.247541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:50.247813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:50.248118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] PATH_INFO: `/v3/users/a72cb126eed743b5ac18c5fad0d7adc8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:50.249457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72cb126eed743b5ac18c5fad0d7adc8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:50.251624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:50.304233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72cb126eed743b5ac18c5fad0d7adc8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.316972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72cb126eed743b5ac18c5fad0d7adc8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.325571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72cb126eed743b5ac18c5fad0d7adc8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.326200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72cb126eed743b5ac18c5fad0d7adc8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.326823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72cb126eed743b5ac18c5fad0d7adc8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.339367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1132/2293] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:45:50 2022] DELETE /identity/v3/users/a72cb126eed743b5ac18c5fad0d7adc8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:50.534550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:50.548437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa798daa-5c91-44f2-ab46-59093e457d66 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:50.633248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:50.634181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:50.634471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:50.634798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] PATH_INFO: `/v3/projects/af44abf5d6d74f8e8d25c7dbbc9b1aa3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:50.636342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af44abf5d6d74f8e8d25c7dbbc9b1aa3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:50.638577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:50.704921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af44abf5d6d74f8e8d25c7dbbc9b1aa3', 'request_id': 'req-b023db82-1424-4ec8-a561-ed2de6a73354'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.714421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af44abf5d6d74f8e8d25c7dbbc9b1aa3', 'request_id': 'req-b023db82-1424-4ec8-a561-ed2de6a73354'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.723519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af44abf5d6d74f8e8d25c7dbbc9b1aa3', 'request_id': 'req-b023db82-1424-4ec8-a561-ed2de6a73354'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.743279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] The token cache is being invalidate because project af44abf5d6d74f8e8d25c7dbbc9b1aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:45:50.743640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.744445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.751940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1162/2294] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:45:50 2022] DELETE /identity/v3/projects/af44abf5d6d74f8e8d25c7dbbc9b1aa3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:50.758496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:50.761736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:50.793037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba635f-e06a-4fc1-8188-2840eb4ed3bb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:50.830597 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:50.873061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:50.874045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:50.874337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:50.874767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] PATH_INFO: `/v3/users/5766397e3d764cb8ae2cac5a6072b98b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:50.876363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5766397e3d764cb8ae2cac5a6072b98b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:50.879012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:50.936875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5766397e3d764cb8ae2cac5a6072b98b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.950823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5766397e3d764cb8ae2cac5a6072b98b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.960103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5766397e3d764cb8ae2cac5a6072b98b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.960731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5766397e3d764cb8ae2cac5a6072b98b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.961338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-01e1352d-4c77-43f4-b627-4efcbbce5585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5766397e3d764cb8ae2cac5a6072b98b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:50.975605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1133/2295] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:45:50 2022] DELETE /identity/v3/users/5766397e3d764cb8ae2cac5a6072b98b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:51.196906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.199380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:51.213329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023db82-1424-4ec8-a561-ed2de6a73354 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.268119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:51.281371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.282274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.282565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.283166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] PATH_INFO: `/v3/projects/1e1f09e2b4c14a65b8da2a0a01cd7a11` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.284544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1f09e2b4c14a65b8da2a0a01cd7a11)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.286539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.338141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1f09e2b4c14a65b8da2a0a01cd7a11', 'request_id': 'req-ef49e577-c414-4bbd-87e9-822d76074196'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:51.345708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1f09e2b4c14a65b8da2a0a01cd7a11', 'request_id': 'req-ef49e577-c414-4bbd-87e9-822d76074196'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:51.355398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1f09e2b4c14a65b8da2a0a01cd7a11', 'request_id': 'req-ef49e577-c414-4bbd-87e9-822d76074196'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:51.367633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] The token cache is being invalidate because project 1e1f09e2b4c14a65b8da2a0a01cd7a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:45:51.367955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:51.368587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ef49e577-c414-4bbd-87e9-822d76074196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:51.370586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1163/2296] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:45:51 2022] DELETE /identity/v3/projects/1e1f09e2b4c14a65b8da2a0a01cd7a11 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:51.375643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c2720-093e-446f-8041-2bf64c901313 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.376235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c2720-093e-446f-8041-2bf64c901313 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.376340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c2720-093e-446f-8041-2bf64c901313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.396990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-813c2720-093e-446f-8041-2bf64c901313 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:51.398402 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-813c2720-093e-446f-8041-2bf64c901313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:51.458503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1134/2297] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:45:51.466204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.466495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.466773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.485026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:51.486220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:51.494056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1164/2298] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:51.498799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c2720-093e-446f-8041-2bf64c901313 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.508528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c2720-093e-446f-8041-2bf64c901313 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.513033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.513673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.513955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.514225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.514957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:45:51.515265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.516889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.532006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1135/2299] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:45:51.533481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.543457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd909b9-ab1f-431d-b17c-fd0594134ed7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.548434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.549097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.549382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.549656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.550346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.552380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.578947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1165/2300] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:45:51 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:51.583280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.593428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfe10-2299-4388-bf85-c0d727c7cb9c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.625920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:51.654937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.655604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.655923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.656809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.657524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.659778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.681745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1136/2301] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:45:51 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:45:51.686564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.702085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544c7f-0175-4e9b-aa89-5f25df4a7b52 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.706735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.707399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.707681 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.707991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.708726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.710351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.721632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1166/2302] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:51.725716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.736760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d131d-81c7-464b-bc9b-e0809a79765a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.743233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915d0ec-0575-4cb3-8164-4914425bb176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.743923 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915d0ec-0575-4cb3-8164-4914425bb176 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.744236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915d0ec-0575-4cb3-8164-4914425bb176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.744584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915d0ec-0575-4cb3-8164-4914425bb176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.745990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915d0ec-0575-4cb3-8164-4914425bb176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.747778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915d0ec-0575-4cb3-8164-4914425bb176 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.759426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1137/2303] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:45:51.764383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:51.777131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4edba1-b7a1-41ab-a900-b5039e8c4490 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:51.783711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:51.785470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.785470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.785470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] PATH_INFO: `/v3/projects/8bfd93d5cc4c4e22ac3af1d12525704c/users/1247119404cb45cf95130a2e2e627c7b/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.801673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfd93d5cc4c4e22ac3af1d12525704c, user_id=1247119404cb45cf95130a2e2e627c7b, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:51.804448 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:51.820700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1167/2304] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:51 2022] PUT /identity/v3/projects/8bfd93d5cc4c4e22ac3af1d12525704c/users/1247119404cb45cf95130a2e2e627c7b/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:51.831410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:51.831861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:51.832211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:51.863001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] MFA Rules not processed for user `1247119404cb45cf95130a2e2e627c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:51.864243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:51.936534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1138/2305] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:45:51.941483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.007409 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02855893-34b7-4584-818e-87bdfd9225f5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.012410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.013068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.013351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.013626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.014313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.016376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.047203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1168/2306] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:45:51 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:45:52.052311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.063385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f25f5-e51b-4912-a197-f43de8f8f5d2 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.123885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.124479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.124761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.125036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.125739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.127962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.149516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1139/2307] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:45:52 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:45:52.154371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.161128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:52.165347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38aecc-1182-4b73-984e-d288482a7bed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.172018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.173085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.173679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.174314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.175064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.176767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.188371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1169/2308] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:52.192535 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.203138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443040d-f28f-4302-8a5c-6d58fd3b9dde admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.208299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.209282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.209574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.209856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] PATH_INFO: `/v3/projects/a5fc328da8684bdb837963ff92ade2d0/users/8f9d492081ad42c485ab8eaa4d9ec350/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.226096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fc328da8684bdb837963ff92ade2d0, user_id=8f9d492081ad42c485ab8eaa4d9ec350, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.228878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.243134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1140/2309] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:52 2022] PUT /identity/v3/projects/a5fc328da8684bdb837963ff92ade2d0/users/8f9d492081ad42c485ab8eaa4d9ec350/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:52.247155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.257670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6996e-4e59-40fd-b823-a0832a5cd1b6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.318156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60fec0-4fc3-464c-9789-32d63486a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.318827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60fec0-4fc3-464c-9789-32d63486a332 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.319113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60fec0-4fc3-464c-9789-32d63486a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.319389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60fec0-4fc3-464c-9789-32d63486a332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.320170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60fec0-4fc3-464c-9789-32d63486a332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.322469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60fec0-4fc3-464c-9789-32d63486a332 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.334431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1170/2310] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:45:52.338986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.349673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb69d5-26b5-4d68-91e1-b2b336db5a66 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.354963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.356164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.356515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.356870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] PATH_INFO: `/v3/projects/a5fc328da8684bdb837963ff92ade2d0/users/8f9d492081ad42c485ab8eaa4d9ec350/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.358888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fc328da8684bdb837963ff92ade2d0, user_id=8f9d492081ad42c485ab8eaa4d9ec350, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.361634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.365012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:52.382752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1141/2311] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:52 2022] PUT /identity/v3/projects/a5fc328da8684bdb837963ff92ade2d0/users/8f9d492081ad42c485ab8eaa4d9ec350/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:52.395152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.395454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.395744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.428717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] MFA Rules not processed for user `8f9d492081ad42c485ab8eaa4d9ec350`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:52.429993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:52.502901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1171/2312] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:52.515387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.517823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:52.596480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132e8b-1984-4b4d-a462-c8a85ca7c723 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.600975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.601646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.601937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.602222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.613301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.614754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.627055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1142/2313] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:52.704462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:52.715244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce8ce-8713-44e5-962f-4ddf7f8d342e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:52.719232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8653b-8af2-46cf-ad87-ee2ad9df1fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:52.719911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8653b-8af2-46cf-ad87-ee2ad9df1fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:52.720197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8653b-8af2-46cf-ad87-ee2ad9df1fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:52.720469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8653b-8af2-46cf-ad87-ee2ad9df1fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:52.789633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8653b-8af2-46cf-ad87-ee2ad9df1fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:52.791205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8653b-8af2-46cf-ad87-ee2ad9df1fb3 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:52.802280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1172/2314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:53.101251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:53.192242 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf6af-6b16-4bb6-b5e9-aa0c7f8542a5 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:53.197256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:53.199098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:53.199594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:53.199992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] PATH_INFO: `/v3/users/1247119404cb45cf95130a2e2e627c7b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:53.201246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1247119404cb45cf95130a2e2e627c7b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:53.203428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:53.260331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1247119404cb45cf95130a2e2e627c7b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.278372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1247119404cb45cf95130a2e2e627c7b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.287204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1247119404cb45cf95130a2e2e627c7b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.288040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1247119404cb45cf95130a2e2e627c7b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.288978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1247119404cb45cf95130a2e2e627c7b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.303613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1143/2315] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:45:53 2022] DELETE /identity/v3/users/1247119404cb45cf95130a2e2e627c7b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:53.309123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:53.309604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:53.309786 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:53.334508 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:53.335876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:53.347194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:53.417336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1173/2316] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:45:53.426903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:53.429324 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:53.467800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:53.504488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bedf1-defe-4cf2-a00c-076ee7fc8be6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:53.508646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:53.509114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:53.509399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:53.509677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:53.520120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:53.521771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:53.533006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1144/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:45:53.872835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:53.874341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:53.891322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d28f1-fb65-4361-88e0-fab2b9c32cdb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:53.897474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:53.898348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:53.898629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:53.898905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] PATH_INFO: `/v3/projects/8bfd93d5cc4c4e22ac3af1d12525704c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:53.900126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfd93d5cc4c4e22ac3af1d12525704c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:53.902858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:53.954032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfd93d5cc4c4e22ac3af1d12525704c', 'request_id': 'req-438a097e-d007-4fb3-b248-c4715e7f08c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.960567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfd93d5cc4c4e22ac3af1d12525704c', 'request_id': 'req-438a097e-d007-4fb3-b248-c4715e7f08c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.967194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfd93d5cc4c4e22ac3af1d12525704c', 'request_id': 'req-438a097e-d007-4fb3-b248-c4715e7f08c2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.981271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] The token cache is being invalidate because project 8bfd93d5cc4c4e22ac3af1d12525704c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:45:53.981586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.982217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:53.986723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1174/2318] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:45:53 2022] DELETE /identity/v3/projects/8bfd93d5cc4c4e22ac3af1d12525704c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:53.987933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:53.997746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846508c-e306-4e08-b57b-6ad0e4a45cae service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.055571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.056456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.056739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.057010 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] PATH_INFO: `/v3/users/8f9d492081ad42c485ab8eaa4d9ec350` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.058309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9d492081ad42c485ab8eaa4d9ec350)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.060273 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.104974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9d492081ad42c485ab8eaa4d9ec350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.116654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9d492081ad42c485ab8eaa4d9ec350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.124077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9d492081ad42c485ab8eaa4d9ec350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.124697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9d492081ad42c485ab8eaa4d9ec350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.125303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-db3737e1-d4b7-4d1d-9345-c647abed463a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9d492081ad42c485ab8eaa4d9ec350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.137689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1145/2319] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:45:53 2022] DELETE /identity/v3/users/8f9d492081ad42c485ab8eaa4d9ec350 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:54.475109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:54.476582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:54.490243 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a097e-d007-4fb3-b248-c4715e7f08c2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.546991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.547942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.548236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.548514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] PATH_INFO: `/v3/projects/a5fc328da8684bdb837963ff92ade2d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.549708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5fc328da8684bdb837963ff92ade2d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.551685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.592399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:54.601057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5fc328da8684bdb837963ff92ade2d0', 'request_id': 'req-75e06a17-07b9-436e-b84e-3b06f076cd00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.607174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5fc328da8684bdb837963ff92ade2d0', 'request_id': 'req-75e06a17-07b9-436e-b84e-3b06f076cd00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.612711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5fc328da8684bdb837963ff92ade2d0', 'request_id': 'req-75e06a17-07b9-436e-b84e-3b06f076cd00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.624663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] The token cache is being invalidate because project a5fc328da8684bdb837963ff92ade2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:45:54.625279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.625908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e06a17-07b9-436e-b84e-3b06f076cd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:45:54.627741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1175/2320] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:45:54 2022] DELETE /identity/v3/projects/a5fc328da8684bdb837963ff92ade2d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:54.632789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.633288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.633371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.652670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:54.653883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:54.687099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:54.713288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1146/2321] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:54.721700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.721996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.722279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.739968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:54.741154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:54.749848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1176/2322] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:45:54.754368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:54.765072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54641-f10f-42b5-926c-059cc15bc939 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.769810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.770474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.770762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.771041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.771790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:45:54.772144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.774077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.785558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1147/2323] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:45:54.789956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:54.799132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89ba8-a62e-4a7a-be5e-b1fcefa150ab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.803764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.804445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.804730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.805036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.805729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.808412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.836402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1177/2324] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:45:54 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:45:54.837435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:54.847326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376456b-dd2f-4254-85a6-5eba1af45653 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.904322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.905035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.905320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.905600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.906295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.908280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.927322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1148/2325] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:45:54 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:45:54.931421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:54.942044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b474f6-3ddf-4d43-8cd0-ed8d2339e86b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.946733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.947418 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.947703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.950717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.951543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.953199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.963686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1178/2326] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:54.967661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:54.977565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61afd9b-7fd5-4f15-875f-4fe132839318 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:54.982169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be39fbc-e69a-4761-ba77-7073412fb146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:54.982814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be39fbc-e69a-4761-ba77-7073412fb146 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:54.983101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be39fbc-e69a-4761-ba77-7073412fb146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:54.983382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be39fbc-e69a-4761-ba77-7073412fb146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:54.984153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be39fbc-e69a-4761-ba77-7073412fb146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:54.985751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be39fbc-e69a-4761-ba77-7073412fb146 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:54.996090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1149/2327] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:45:54.999928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:55.010182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d55c-e781-4688-bcf7-015adc011e75 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:55.015745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:55.016676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:55.016966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:55.017248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] PATH_INFO: `/v3/projects/81035d15f44c4fc3a43b876891de6e60/users/2996a304f82c4c21a6e9b37d3dba87f7/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:55.032131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81035d15f44c4fc3a43b876891de6e60, user_id=2996a304f82c4c21a6e9b37d3dba87f7, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:55.034843 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:55.048568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1179/2328] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:45:54 2022] PUT /identity/v3/projects/81035d15f44c4fc3a43b876891de6e60/users/2996a304f82c4c21a6e9b37d3dba87f7/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:45:55.059361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b46e-3cf7-47e4-88a1-10d2b3d2ff79 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:55.059660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b46e-3cf7-47e4-88a1-10d2b3d2ff79 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:55.060007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b46e-3cf7-47e4-88a1-10d2b3d2ff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:55.085797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0873b46e-3cf7-47e4-88a1-10d2b3d2ff79 None None] MFA Rules not processed for user `2996a304f82c4c21a6e9b37d3dba87f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:45:55.087011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0873b46e-3cf7-47e4-88a1-10d2b3d2ff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:55.149995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1150/2329] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:45:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:45:55.161389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:45:55.163062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:45:55.219127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d058ba-f3a4-4eef-a0eb-91088e24023e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:45:55.222646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:45:55.223288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:45:55.223570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:45:55.223859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:45:55.232758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:45:55.234188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:45:55.243117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1180/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:45:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:05.147046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:05.239269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:29.330025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:29.330526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:29.330526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:29.348714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:29.349979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:29.404222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1151/2331] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:46:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:29.450072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:29.452136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:29.526932 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc428b29-edc7-44c6-94d8-48da09fae897 service glance] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:29.532278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:29.532933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:29.533227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:29.533511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:29.542188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:29.543796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:29.552948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1181/2332] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:46:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:46:39.397030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=25 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:39.549240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=32 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:42.880265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:42.881664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:42.951291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342fe02-ecff-47d8-8a5a-4ad57c67fbbf None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:42.958821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:42.959607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:42.959932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:42.960440 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:42.962721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:42.975118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:42.976812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108dd17-fe86-4d00-8662-00afe7de180b service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:42.986735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1152/2333] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:45.452548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:45.519367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d7bd-3e77-4bd2-b407-a320ac97c931 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:45.524155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:45.525041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:45.525322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:45.525601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] PATH_INFO: `/v3/users/2996a304f82c4c21a6e9b37d3dba87f7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:45.526792 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2996a304f82c4c21a6e9b37d3dba87f7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:45.528788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:45.586846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2996a304f82c4c21a6e9b37d3dba87f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:45.600670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2996a304f82c4c21a6e9b37d3dba87f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:45.608746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2996a304f82c4c21a6e9b37d3dba87f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:45.609378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2996a304f82c4c21a6e9b37d3dba87f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:45.616589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2996a304f82c4c21a6e9b37d3dba87f7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:45.622638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1182/2334] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:46:45 2022] DELETE /identity/v3/users/2996a304f82c4c21a6e9b37d3dba87f7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:46:45.628033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:45.628527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:45.628739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:45.647129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:45.648568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:45.740941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1153/2335] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:45.750779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:45.752465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:45.815974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cce15-de0f-40ef-8385-7af714168e84 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:45.819575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f11af-9fd6-413a-97f3-08ca5ac62c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:45.820265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f11af-9fd6-413a-97f3-08ca5ac62c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:45.820554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f11af-9fd6-413a-97f3-08ca5ac62c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:45.820829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f11af-9fd6-413a-97f3-08ca5ac62c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:45.832604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f11af-9fd6-413a-97f3-08ca5ac62c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:45.834060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f11af-9fd6-413a-97f3-08ca5ac62c30 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:45.846645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1183/2336] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:46.126567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.128062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:46.140097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c38c-0551-496d-b900-bfed0a265572 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.144986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.145851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.146142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.146428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] PATH_INFO: `/v3/projects/81035d15f44c4fc3a43b876891de6e60` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.149693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81035d15f44c4fc3a43b876891de6e60)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.149693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.197278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81035d15f44c4fc3a43b876891de6e60', 'request_id': 'req-0ee22cdb-3447-4229-84ef-604a8fe277d4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:46.203708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81035d15f44c4fc3a43b876891de6e60', 'request_id': 'req-0ee22cdb-3447-4229-84ef-604a8fe277d4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:46.209351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81035d15f44c4fc3a43b876891de6e60', 'request_id': 'req-0ee22cdb-3447-4229-84ef-604a8fe277d4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:46.221451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] The token cache is being invalidate because project 81035d15f44c4fc3a43b876891de6e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:46:46.221738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:46.222361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0ee22cdb-3447-4229-84ef-604a8fe277d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:46.223929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1154/2337] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:46:46 2022] DELETE /identity/v3/projects/81035d15f44c4fc3a43b876891de6e60 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:46:46.228750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.229045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.229350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.247683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:46.249742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:46.266450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:46.313375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1184/2338] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:46.322171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.322467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.322868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.342973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:46.344248 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:46.352252 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1155/2339] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:46.356525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.367439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e469c-f514-49f3-9d69-e371f0b0a0f9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.372546 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.373222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.373639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.374038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.374788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:46:46.375137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.377063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.390013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1185/2340] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:46:46.394302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.403579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195b78-2d27-4fe7-a637-888760b860a3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.409006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.409662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.409954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.410231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.410927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.412904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.416724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:46.443473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1156/2341] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:46:46 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:46:46.447605 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.457660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946608-05fa-4847-af70-d65b9800f89c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.516132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.516811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.517099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.517380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.518072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.520102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.540674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1186/2342] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:46:46 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:46:46.546106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.557103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077df5-5b8a-4168-8c47-c196cd338b4f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.561836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.562494 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.562777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.563049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.563850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.565506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.579199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1157/2343] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:46:46.582867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.594005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a3e6a-837d-4c33-b7b4-d02719d306fb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.601634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672878f-81f3-440e-9aad-6d5f9250a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.602919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672878f-81f3-440e-9aad-6d5f9250a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.603273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672878f-81f3-440e-9aad-6d5f9250a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.604571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672878f-81f3-440e-9aad-6d5f9250a4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.605487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672878f-81f3-440e-9aad-6d5f9250a4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.607355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672878f-81f3-440e-9aad-6d5f9250a4a5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.620218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1187/2344] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:46:46.624543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.634891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee622b-2bed-4b90-8e07-66634ffb70a2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.640276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.641108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.641386 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.641659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] PATH_INFO: `/v3/projects/102bfc32672b4118836380140c174625/users/d0156ca1a9f646f69222f7c418d9aadb/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.656382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=102bfc32672b4118836380140c174625, user_id=d0156ca1a9f646f69222f7c418d9aadb, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.659074 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.673168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1158/2345] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:46:46 2022] PUT /identity/v3/projects/102bfc32672b4118836380140c174625/users/d0156ca1a9f646f69222f7c418d9aadb/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:46:46.683650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.683977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.684265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.713853 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] MFA Rules not processed for user `d0156ca1a9f646f69222f7c418d9aadb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:46.715255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:46.796804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1188/2346] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:46.808384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.810104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:46.870754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84e12-075c-4c0e-bc1d-041fa59dc7ab admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.874978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45317bbe-3a49-4a72-a8ac-f2c2ce4422cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.875636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317bbe-3a49-4a72-a8ac-f2c2ce4422cf service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.875949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317bbe-3a49-4a72-a8ac-f2c2ce4422cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.876232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317bbe-3a49-4a72-a8ac-f2c2ce4422cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:46.885594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45317bbe-3a49-4a72-a8ac-f2c2ce4422cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:46.887055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45317bbe-3a49-4a72-a8ac-f2c2ce4422cf service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:46.896609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1159/2347] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:46.921821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:46.942723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:46.992024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d14e1-bcd1-4163-b245-c39fd058ff88 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:46.997053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:46.998076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:46.998922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:46.999186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] PATH_INFO: `/v3/users/d0156ca1a9f646f69222f7c418d9aadb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.000581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0156ca1a9f646f69222f7c418d9aadb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:47.002798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:47.055000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0156ca1a9f646f69222f7c418d9aadb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.074643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0156ca1a9f646f69222f7c418d9aadb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.077983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0156ca1a9f646f69222f7c418d9aadb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.078669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0156ca1a9f646f69222f7c418d9aadb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.086278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0156ca1a9f646f69222f7c418d9aadb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.093439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1189/2348] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:46:46 2022] DELETE /identity/v3/users/d0156ca1a9f646f69222f7c418d9aadb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:46:47.097754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8efc3-7af1-4c09-a7c4-99593f253e5f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.098051 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8efc3-7af1-4c09-a7c4-99593f253e5f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.098334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8efc3-7af1-4c09-a7c4-99593f253e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.117638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-eec8efc3-7af1-4c09-a7c4-99593f253e5f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:47.118911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eec8efc3-7af1-4c09-a7c4-99593f253e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.178216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1160/2349] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:47.189397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:47.190833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.251693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e1fe-4e47-4e77-a5bd-e0f3d671e30d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:47.255321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:47.255993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.256280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.256555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.265524 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:47.266957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:47.276277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1190/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:46:47.362024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.362322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.362612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.381996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:47.383393 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.440166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:47.450543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1161/2351] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:47.463045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:47.464503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.511699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:47.544516 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2085-ed2b-43d3-adc4-b1ca1932ccfc service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:47.550372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373ebf8-bd43-4341-9246-1bc064845aac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:47.551030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ebf8-bd43-4341-9246-1bc064845aac service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.551909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ebf8-bd43-4341-9246-1bc064845aac service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.551909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ebf8-bd43-4341-9246-1bc064845aac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.561808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373ebf8-bd43-4341-9246-1bc064845aac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:47.563450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373ebf8-bd43-4341-9246-1bc064845aac service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:47.572678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1191/2352] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:46:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:46:47.582378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:47.584113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.600697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f7624-ced1-45c9-a788-4b53a540a5c9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:47.606077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:47.606676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.606971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.607255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] PATH_INFO: `/v3/projects/102bfc32672b4118836380140c174625` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.609037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102bfc32672b4118836380140c174625)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:47.611213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:47.667966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102bfc32672b4118836380140c174625', 'request_id': 'req-824fcad4-fe2e-4ff8-a713-ddab14899992'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.677686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102bfc32672b4118836380140c174625', 'request_id': 'req-824fcad4-fe2e-4ff8-a713-ddab14899992'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.684338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102bfc32672b4118836380140c174625', 'request_id': 'req-824fcad4-fe2e-4ff8-a713-ddab14899992'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.704892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] The token cache is being invalidate because project 102bfc32672b4118836380140c174625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:46:47.705300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.706084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-824fcad4-fe2e-4ff8-a713-ddab14899992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:46:47.708238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1162/2353] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:46:47 2022] DELETE /identity/v3/projects/102bfc32672b4118836380140c174625 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:46:47.713934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.714532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.715192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.769992 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:47.772236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.914262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1192/2354] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:47.924312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.924937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.925629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.952727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:47.953882 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:47.970772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1163/2355] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:46:47.971990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:47.982505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8592d1-eafb-4ec2-be74-5b572fb1ff3e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:47.987978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:47.988867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:47.989167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:47.989523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:47.994084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:46:47.994084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:47.994084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.011189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1193/2356] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:46:48.015399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:48.025206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfc8a6-4ff1-4c55-8c2b-75d08ddc2230 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:48.030451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:48.031208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.031486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.031773 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.032519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:48.034468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.066512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1164/2357] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:46:48 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:46:48.070654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:48.081966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b653b-ca88-410a-92eb-12c5c379056d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:48.171668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:48.172772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.173061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.173336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.174391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:48.176841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.221876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:48.227447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1194/2358] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:46:48 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:46:48.237326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef99553-cea4-4f77-88fb-9ad9a9a670bd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:48.242227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:48.242915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.243206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.243488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.244269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:48.245896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.261735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:48.268739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1165/2359] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:46:48.272920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e32b-25f7-4085-8146-a4fe92f58448 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:48.304652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbdb40-76d5-4bbc-9c30-764cf6eae16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:48.305416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbdb40-76d5-4bbc-9c30-764cf6eae16f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.305769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbdb40-76d5-4bbc-9c30-764cf6eae16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.306114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbdb40-76d5-4bbc-9c30-764cf6eae16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.306928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbdb40-76d5-4bbc-9c30-764cf6eae16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:48.308666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbdb40-76d5-4bbc-9c30-764cf6eae16f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.334780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:48.346273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1195/2360] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:46:48.353826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755e9e1-9386-4fca-8a3f-08a9ab9277ec admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:48.359230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:48.360304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.360641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.360926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] PATH_INFO: `/v3/projects/500e8157246e450ea87f751218856c7a/users/5b995c6bf02b4e50aa836324c6f3414e/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.378637 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] RBAC: Authorizing `identity:create_grant(project_id=500e8157246e450ea87f751218856c7a, user_id=5b995c6bf02b4e50aa836324c6f3414e, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:48.381630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.397546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1166/2361] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:46:48 2022] PUT /identity/v3/projects/500e8157246e450ea87f751218856c7a/users/5b995c6bf02b4e50aa836324c6f3414e/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:46:48.402658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.402947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.403233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.434972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:48.437174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:48.475108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:48.509144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1196/2362] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:48.519917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:48.521869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:48.585547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704770c-60d9-4a35-a237-cd48539e502e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:48.589121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43711bde-c860-41d1-aaa3-56d9f6319ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:48.589778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711bde-c860-41d1-aaa3-56d9f6319ede service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:48.590069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711bde-c860-41d1-aaa3-56d9f6319ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:48.590349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711bde-c860-41d1-aaa3-56d9f6319ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:48.600475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711bde-c860-41d1-aaa3-56d9f6319ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:48.601959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711bde-c860-41d1-aaa3-56d9f6319ede service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:48.612655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1167/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:49.169180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:49.171150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:49.294018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d8ab6-f0e9-4627-bd23-004eec26ccea None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:49.304584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:49.305346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:49.305632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:49.305916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:49.310150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:49.340015 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:49.340779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:49.340779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:49.373865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] MFA Rules not processed for user `5b995c6bf02b4e50aa836324c6f3414e`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:49.375160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:49.385829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:49.451560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:49.454185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c41f2a-afa6-4bb8-8e3b-e2a455f19450 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:49.474835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1168/2364] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:49.477824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:46:49.478248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1197/2365] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:49.480129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:49.497135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac19f1d-5db6-4e28-8e6e-63f9b325d577 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:46:49.509018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcd86d-4130-4245-a6c6-f2bc62f43660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:46:49.509689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcd86d-4130-4245-a6c6-f2bc62f43660 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:49.510062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcd86d-4130-4245-a6c6-f2bc62f43660 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:49.510874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcd86d-4130-4245-a6c6-f2bc62f43660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:49.522723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcd86d-4130-4245-a6c6-f2bc62f43660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:46:49.524695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcd86d-4130-4245-a6c6-f2bc62f43660 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:46:49.537336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1169/2366] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:46:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:46:58.498062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1d1a-1732-4217-9a39-e9161be693fc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:46:58.498801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1d1a-1732-4217-9a39-e9161be693fc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:46:58.498910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1d1a-1732-4217-9a39-e9161be693fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:46:58.517049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fd0d1d1a-1732-4217-9a39-e9161be693fc None None] MFA Rules not processed for user `5b995c6bf02b4e50aa836324c6f3414e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:46:58.518270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd0d1d1a-1732-4217-9a39-e9161be693fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:46:58.525439 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1198/2367] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:46:59.531340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=29 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:02.738738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:47:02.739367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:47:02.739367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:47:02.757620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] MFA Rules not processed for user `00cfbc965d934d6db28f41f8082eb5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:47:02.758826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:47:02.766436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1170/2368] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:47:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:47:08.511588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=62 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:09.795360 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:47:09.796362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:47:09.796650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:47:09.819182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:47:09.820453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:47:09.881631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1199/2369] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 18:47:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:47:09.894902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:47:09.896673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:47:09.973683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df301-ef6f-4e17-b5fa-9b4d218ec245 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:47:09.978713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:47:09.979394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:47:09.979684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:47:09.980000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:47:09.988673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:47:09.990316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:47:09.999200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1171/2370] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:47:19.874714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=25 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:19.995759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=35 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:23.592528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:47:23.593983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:47:23.606055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc02db-3b80-428f-8070-e5bcf43c680b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:47:23.610727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:47:23.611378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:47:23.611661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:47:23.611969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:47:23.614386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:47:23.682998 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:47:23.685091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:47:23.694585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1200/2371] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:47:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:47:33.690438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=30 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:52.004391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:47:52.013606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9431b-53d4-410e-88a5-fc0d454eb860 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:47:52.018175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:47:52.018814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:47:52.019126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:47:52.019404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:47:52.021215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:47:52.090235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:47:52.091686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:47:52.102755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1172/2372] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:47:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:02.098085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=34 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:08.635203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:08.645022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca55ba9-5430-4129-b489-c5f4854075c7 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:08.648580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:08.649214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:08.649504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:08.649781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:08.651525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:08.665054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:08.666479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006c39-7c1e-4eed-be53-bdfbd1f9ff46 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:08.677581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1201/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:18.672640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:37.168979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:37.177608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46c54-0657-4b88-8c33-6752a6a93b97 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:37.181225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:37.181855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:37.182148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:37.182426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:37.184219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:37.262791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:37.265033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:37.282883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1173/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:39.401080 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:39.401584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:39.401673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:39.421156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] MFA Rules not processed for user `5b995c6bf02b4e50aa836324c6f3414e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:39.422551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:39.432326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1202/2375] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:48:39.673251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:39.682360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aabd3f-4435-4a3e-ae06-ca5324d5e0b6 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:39.686411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:39.687113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:39.687401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:39.687675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:39.689463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:39.698626 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:39.700070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:39.708411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1174/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:40.044282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:40.046000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:40.114830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61019a-3347-4530-b354-2a3de9420f1b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:40.120097 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:40.120742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:40.121056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:40.121348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:40.123087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:40.134828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:40.136466 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:40.146593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1203/2377] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:41.810315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:41.819683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971d6f5-9f1f-488b-b337-238677764487 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:41.823213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:41.824099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:41.824392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:41.824675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:41.827940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:41.837849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:41.839268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb5f6-b52d-4f3b-a526-eb4213c227e2 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:41.848084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1175/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:42.900910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:42.911214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8545b-0a3f-4b31-88d4-875347399402 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:42.915120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:42.915790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:42.916112 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:42.916399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:42.918344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:42.931336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:42.932848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f4f4a-6755-4608-a1c1-9687a62ff615 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:42.943562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1204/2379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:46.173666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1d982-352f-4a3a-9da9-3cb6ee389f51 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.174154 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1d982-352f-4a3a-9da9-3cb6ee389f51 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.174412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1d982-352f-4a3a-9da9-3cb6ee389f51 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.175873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1176/2380] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:48:46.187789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.188333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.188434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.229483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] MFA Rules not processed for user `9f3f2c10f9fc444aba93f0d999359662`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:46.230696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:46.240237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1205/2381] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:48:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:46.268685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1d982-352f-4a3a-9da9-3cb6ee389f51 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:46.285837 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1d982-352f-4a3a-9da9-3cb6ee389f51 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:46.291642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:46.292330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.292620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.292906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.303821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:46.308113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:46.309623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:46.310072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:46.323988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1177/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:46.327818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde4a2-c40e-4903-b772-e119463da0ee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:46.333035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:46.334146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.334474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.334883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] PATH_INFO: `/v3/users/d32582f1a1994e3b9c05f56185d0079d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.336291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32582f1a1994e3b9c05f56185d0079d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:46.339172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:46.392974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32582f1a1994e3b9c05f56185d0079d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.405041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32582f1a1994e3b9c05f56185d0079d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.412345 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32582f1a1994e3b9c05f56185d0079d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.413249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32582f1a1994e3b9c05f56185d0079d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.420839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-006a351c-0af2-4875-9b13-b51e94cfd85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32582f1a1994e3b9c05f56185d0079d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.426925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1206/2383] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:48:46 2022] DELETE /identity/v3/users/d32582f1a1994e3b9c05f56185d0079d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:46.616936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:46.629271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58929b-8b1e-4a63-8392-e82cde8af517 service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:46.690580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:46.691444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.691728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.692033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] PATH_INFO: `/v3/projects/b91b10b850024bae8e0d76aa9628224d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.693229 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91b10b850024bae8e0d76aa9628224d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:46.695158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:46.731585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:46.744864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91b10b850024bae8e0d76aa9628224d', 'request_id': 'req-812a21dd-4fc3-41fa-94df-54bc0d751f2a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.750967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91b10b850024bae8e0d76aa9628224d', 'request_id': 'req-812a21dd-4fc3-41fa-94df-54bc0d751f2a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.756992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91b10b850024bae8e0d76aa9628224d', 'request_id': 'req-812a21dd-4fc3-41fa-94df-54bc0d751f2a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.769870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] The token cache is being invalidate because project b91b10b850024bae8e0d76aa9628224d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:48:46.770163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.770802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-812a21dd-4fc3-41fa-94df-54bc0d751f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:46.772875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1178/2384] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:48:46 2022] DELETE /identity/v3/projects/b91b10b850024bae8e0d76aa9628224d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:46.777344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.777623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.777902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.797039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:46.798251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:46.815117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:46.859823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1207/2385] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:46.867646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.867985 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.868269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.886731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:46.887964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:46.896755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1179/2386] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:46.900873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:46.911030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85f0a7-650e-46a9-a2c4-5abb56f8824f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:46.915529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:46.916206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.916491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.916764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.917485 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:48:46.917793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:46.919410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:46.930847 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1208/2387] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:48:46.935038 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:46.944834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c9c54-9a17-4c0d-8653-0379b8404001 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:46.949484 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:46.950129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:46.950416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:46.950698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:46.952083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:46.954016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:46.981422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1180/2388] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:46 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:46.985564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:46.996131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8630e-eb0f-4ad3-871a-2a776e8562b5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.054294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.054970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.055258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.055537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.056276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.058354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.081010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1209/2389] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:48:46 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:47.085049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.097497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6e74-e0a2-47df-893a-82240a31f649 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.102607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.103323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.103615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.103925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.104666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.106322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.118849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1181/2390] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:47.123638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.135354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cfd11-5933-481f-845e-946eb9cc373d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.141889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0dfe1-e930-4660-b39f-5b6f03441842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.142568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0dfe1-e930-4660-b39f-5b6f03441842 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.142858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0dfe1-e930-4660-b39f-5b6f03441842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.143145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0dfe1-e930-4660-b39f-5b6f03441842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.143914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0dfe1-e930-4660-b39f-5b6f03441842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.145885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0dfe1-e930-4660-b39f-5b6f03441842 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.156511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1210/2391] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:47.160655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.171595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954e5b4-4b9c-4c85-82cd-94110d819ed5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.176638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.177606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.177964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.178320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] PATH_INFO: `/v3/projects/bbcf5642219d4686992f51789311ae56/users/ac7c1ecc492248379851130f1092c4e4/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.194049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcf5642219d4686992f51789311ae56, user_id=ac7c1ecc492248379851130f1092c4e4, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.196831 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.209627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1182/2392] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:47 2022] PUT /identity/v3/projects/bbcf5642219d4686992f51789311ae56/users/ac7c1ecc492248379851130f1092c4e4/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:48:47.220799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.221279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.221377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.249989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] MFA Rules not processed for user `ac7c1ecc492248379851130f1092c4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:47.251211 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:47.315219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1211/2393] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:47.320097 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.382261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0202-d150-460b-8af7-422f0f0b5285 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.386881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.387540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.387826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.388130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.389344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.391287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.422634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1183/2394] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:47 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:48:47.426579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.438560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486cc3-4cad-49fc-9b8f-95f009f4e2e1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.455701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:47.510829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.511515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.511798 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.512121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.512827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.516809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.544157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1212/2395] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:48:47 2022] POST /identity/v3/users => generated 309 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:48:47.545556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.557601 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234266c2-f065-4048-90a4-d671534df211 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.563642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.564345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.564633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.564901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.565634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.567239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.578632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1184/2396] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:48:47.583007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.594327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35eeca-e67c-4ef2-938a-d9f862b85743 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.599105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.600130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.600480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.600829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] PATH_INFO: `/v3/projects/327010821d224e0f827d2d4b57a7bf9e/users/141f7e9025b340a8908e12671ba9568b/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.617387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=327010821d224e0f827d2d4b57a7bf9e, user_id=141f7e9025b340a8908e12671ba9568b, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.620301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.634814 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1213/2397] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:47 2022] PUT /identity/v3/projects/327010821d224e0f827d2d4b57a7bf9e/users/141f7e9025b340a8908e12671ba9568b/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:47.639326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.649265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867523e-79c4-4f6d-81db-17ea6cf8183c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.678366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:47.708529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15766a5-da02-41a7-b60e-d8e273b34142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.709192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15766a5-da02-41a7-b60e-d8e273b34142 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.709479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15766a5-da02-41a7-b60e-d8e273b34142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.709750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15766a5-da02-41a7-b60e-d8e273b34142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.710476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15766a5-da02-41a7-b60e-d8e273b34142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.712095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15766a5-da02-41a7-b60e-d8e273b34142 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.725741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1185/2398] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:47.727896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.738673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6e67-1711-42dd-8f8d-05d09e2c91ef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.745332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.746066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.746449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.746826 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] PATH_INFO: `/v3/projects/327010821d224e0f827d2d4b57a7bf9e/users/141f7e9025b340a8908e12671ba9568b/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.750089 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=327010821d224e0f827d2d4b57a7bf9e, user_id=141f7e9025b340a8908e12671ba9568b, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.756673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.768739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1214/2399] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:47 2022] PUT /identity/v3/projects/327010821d224e0f827d2d4b57a7bf9e/users/141f7e9025b340a8908e12671ba9568b/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:47.781915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.782285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.782639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.809590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] MFA Rules not processed for user `141f7e9025b340a8908e12671ba9568b`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:47.810957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:47.888319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1186/2400] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:47.900051 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:47.901927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:47.963595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369b05-485f-4b1a-9e3a-d42cb4d55a8e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:47.967256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023442-8f61-4011-99c0-e7611853f751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:47.967938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023442-8f61-4011-99c0-e7611853f751 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:47.968223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023442-8f61-4011-99c0-e7611853f751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:47.968499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023442-8f61-4011-99c0-e7611853f751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:47.978000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5023442-8f61-4011-99c0-e7611853f751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:47.979456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5023442-8f61-4011-99c0-e7611853f751 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:47.989172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1215/2401] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:48.126623 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:48.190475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a723172-b381-4179-9b7c-15a8f7cf37f7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:48.195065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:48.196061 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:48.200152 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:48.200456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] PATH_INFO: `/v3/users/ac7c1ecc492248379851130f1092c4e4` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:48.202736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7c1ecc492248379851130f1092c4e4)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:48.204831 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:48.260167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7c1ecc492248379851130f1092c4e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.268781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:48.273618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7c1ecc492248379851130f1092c4e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.281234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7c1ecc492248379851130f1092c4e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.281871 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7c1ecc492248379851130f1092c4e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.282471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7c1ecc492248379851130f1092c4e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.296412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1187/2402] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:48:48 2022] DELETE /identity/v3/users/ac7c1ecc492248379851130f1092c4e4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:48.300964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:48.301513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:48.301513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:48.319619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:48.320866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:48.384422 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1216/2403] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:48.394927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:48.396370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:48.455119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46a850-6572-4c87-9ccb-7c91458e6acc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:48.458715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:48.459346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:48.459748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:48.460059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:48.471142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:48.472962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:48.487190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1188/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:48.881525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:48.883185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:48.898042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2705558-af21-4ba3-9b32-9b20303c4b50 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:48.904883 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:48.906758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:48.906758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:48.914036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] PATH_INFO: `/v3/projects/bbcf5642219d4686992f51789311ae56` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:48.915393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcf5642219d4686992f51789311ae56)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:48.917469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:48.930259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:48.981276 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcf5642219d4686992f51789311ae56', 'request_id': 'req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.990727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcf5642219d4686992f51789311ae56', 'request_id': 'req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:48.998342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcf5642219d4686992f51789311ae56', 'request_id': 'req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.015775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] The token cache is being invalidate because project bbcf5642219d4686992f51789311ae56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:48:49.016130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.017022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.019746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1217/2405] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:48:48 2022] DELETE /identity/v3/projects/bbcf5642219d4686992f51789311ae56 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:49.023969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:49.037410 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b4d3-4bc7-4726-99ab-28b9f2386c9c service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:49.103991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:49.105134 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:49.105572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:49.106305 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] PATH_INFO: `/v3/users/141f7e9025b340a8908e12671ba9568b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:49.107887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] RBAC: Authorizing `identity:delete_user(user_id=141f7e9025b340a8908e12671ba9568b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:49.110233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:49.178549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141f7e9025b340a8908e12671ba9568b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.193578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141f7e9025b340a8908e12671ba9568b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.205674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141f7e9025b340a8908e12671ba9568b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.206594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141f7e9025b340a8908e12671ba9568b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.207346 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-23fcb48e-d591-4188-a863-912d980a754a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141f7e9025b340a8908e12671ba9568b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.213192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:49.225459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1189/2406] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:48:49 2022] DELETE /identity/v3/users/141f7e9025b340a8908e12671ba9568b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:49.523359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:49.524862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:49.550085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e43b-d5a5-4a47-9d83-7ca8b1dbc4c5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:49.651644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:49.652864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:49.653004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:49.653270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] PATH_INFO: `/v3/projects/327010821d224e0f827d2d4b57a7bf9e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:49.654856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327010821d224e0f827d2d4b57a7bf9e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:49.665317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:49.707896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327010821d224e0f827d2d4b57a7bf9e', 'request_id': 'req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.714074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327010821d224e0f827d2d4b57a7bf9e', 'request_id': 'req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.719461 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327010821d224e0f827d2d4b57a7bf9e', 'request_id': 'req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.734166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] The token cache is being invalidate because project 327010821d224e0f827d2d4b57a7bf9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:48:49.734460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.735127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1067c78-bbb3-4fc9-a81b-44ee420b5b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:49.736706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1218/2407] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:48:49 2022] DELETE /identity/v3/projects/327010821d224e0f827d2d4b57a7bf9e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:49.741570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:49.741869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:49.742150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:49.779496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:49.780927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:49.862157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1190/2408] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:49.864753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:49.864753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:49.864753 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:49.885542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:49.887421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:49.901913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1219/2409] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:48:49.906972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:49.918196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27cea-f28b-4cf1-b1f8-a7d04d7f371f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:49.923422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:49.924184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:49.924412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:49.924693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:49.925541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:48:49.925930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:49.927569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:49.947607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:49.955506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1191/2410] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:48:49.965337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324059b-9046-4db5-9360-db8ccc74e827 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:49.977749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:49.978582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:49.978967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:49.979337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:49.980321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:49.990669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.025069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:50.042469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1220/2411] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:49 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:50.047153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.069186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181015-ed47-4354-83dc-95ac7ef45119 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.140335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.141169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.141456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.141736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.142439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.144503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.169517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1192/2412] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:48:50 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:50.173705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.185091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff218b0-5233-47e1-88d4-24ab5d31a4f8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.191004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.191866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.192271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.192634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.193763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.195528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.209392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1221/2413] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:50.213510 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.226031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cd1f5-25a2-4f03-9588-61783375e880 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.232139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7025a00-ffa4-4895-8c95-a8e9ca0e3427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.233164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7025a00-ffa4-4895-8c95-a8e9ca0e3427 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.233648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7025a00-ffa4-4895-8c95-a8e9ca0e3427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.234088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7025a00-ffa4-4895-8c95-a8e9ca0e3427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.235065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7025a00-ffa4-4895-8c95-a8e9ca0e3427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.236818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7025a00-ffa4-4895-8c95-a8e9ca0e3427 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.247445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1193/2414] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:50.252818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.262763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecce6a-9025-4094-9d9a-551545d11f0a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.267679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.268579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.268860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.269134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] PATH_INFO: `/v3/projects/bf61824b3de940a3a58865e78decc8ce/users/0ca94ad10cfa42359678037d4c621ed0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.283090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf61824b3de940a3a58865e78decc8ce, user_id=0ca94ad10cfa42359678037d4c621ed0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.285842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.298665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1222/2415] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:50 2022] PUT /identity/v3/projects/bf61824b3de940a3a58865e78decc8ce/users/0ca94ad10cfa42359678037d4c621ed0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:50.309926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.310216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.310495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.336729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] MFA Rules not processed for user `0ca94ad10cfa42359678037d4c621ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:50.337937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:50.385864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:50.404689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1194/2416] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:50.409650 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.470646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d76db-d5b9-4392-801f-4750ca4735a7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.476114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.476402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.476686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.476965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.477654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.479619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.506374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1223/2417] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:50 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:50.510266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.521013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6bbd-db95-42ba-aa64-c6504a17f86d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.579034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.579705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.580024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.580301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.581006 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.582945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.603035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1195/2418] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:48:50 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:50.607106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.618370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f989b9e-85ad-400c-aa1c-bc8540c31a83 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.622894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.624145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.624431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.624708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.625433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.627307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.639182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1224/2419] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:50.643341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.653560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d9dbb-f3a7-44db-bf46-4e1f213d3e0b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.658859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.659748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.660069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.660378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] PATH_INFO: `/v3/projects/98d40b4924444d608a263e9960cd7693/users/ca1b24c1cc154f798a43ae5371c9bc51/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.679053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d40b4924444d608a263e9960cd7693, user_id=ca1b24c1cc154f798a43ae5371c9bc51, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.681812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.696199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1196/2420] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:50 2022] PUT /identity/v3/projects/98d40b4924444d608a263e9960cd7693/users/ca1b24c1cc154f798a43ae5371c9bc51/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:50.700166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.712021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ef5f6-09c8-495a-b3aa-bf5a7132592b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.783387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0496df4-3028-42a4-9e18-b98b95a08323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.784120 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496df4-3028-42a4-9e18-b98b95a08323 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.784400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496df4-3028-42a4-9e18-b98b95a08323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.784685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496df4-3028-42a4-9e18-b98b95a08323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.785429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0496df4-3028-42a4-9e18-b98b95a08323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.787088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0496df4-3028-42a4-9e18-b98b95a08323 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.798107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1225/2421] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:50.802313 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.813702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22804494-ccbf-4b3e-ae18-e2bdf633e635 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:50.819107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:50.820581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.820941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.821308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] PATH_INFO: `/v3/projects/98d40b4924444d608a263e9960cd7693/users/ca1b24c1cc154f798a43ae5371c9bc51/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.823718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d40b4924444d608a263e9960cd7693, user_id=ca1b24c1cc154f798a43ae5371c9bc51, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:50.827247 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:50.840634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1197/2422] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:50 2022] PUT /identity/v3/projects/98d40b4924444d608a263e9960cd7693/users/ca1b24c1cc154f798a43ae5371c9bc51/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:50.851287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:50.851694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:50.852082 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:50.885991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] MFA Rules not processed for user `ca1b24c1cc154f798a43ae5371c9bc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:50.887529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:50.913441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:50.968520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1226/2423] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:50.980557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:50.982284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:51.042605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e702-fc1f-450d-9ca8-5ebfee41dab2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:51.046433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:51.047083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:51.047372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:51.047653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:51.057002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:51.058493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:51.069261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1198/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:51.418823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:51.428512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f027-615d-40a8-9992-38a88a6a30f7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:51.433332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1b24c1cc154f798a43ae5371c9bc51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d40b4924444d608a263e9960cd7693', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:51.434171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:51.434472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:51.434869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:51.436672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:48:51.436672 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:51.438333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:51.453056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1227/2425] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:48:51.458543 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:51.468215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a023f-a842-4c08-af89-86c9d09aa88e service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:51.472841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1b24c1cc154f798a43ae5371c9bc51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d40b4924444d608a263e9960cd7693', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:51.473495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:51.473790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:51.474076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:51.474788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:51.476801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:51.509037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1199/2426] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:51 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:48:51.510452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:51.520755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0fbc-bed3-4cdc-9c75-1ed58f460d20 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:51.586797 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1b24c1cc154f798a43ae5371c9bc51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d40b4924444d608a263e9960cd7693', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:51.588264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:51.588655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:51.589115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:51.590050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:48:51.590476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:51.593641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:51.610989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1228/2427] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:48:51.646414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:51.657679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58052ec-533b-4f16-b77c-8a30c58549eb tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:51.662284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1b24c1cc154f798a43ae5371c9bc51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d40b4924444d608a263e9960cd7693', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:51.663143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:51.663435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:51.663717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] PATH_INFO: `/v3/projects/da19a5eacb4146bd870c991bb48987a6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:51.664936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da19a5eacb4146bd870c991bb48987a6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:51.666874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:51.685062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:51.720828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da19a5eacb4146bd870c991bb48987a6', 'request_id': 'req-185f8389-a90a-4ce5-a897-52591f54b0f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:51.727500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da19a5eacb4146bd870c991bb48987a6', 'request_id': 'req-185f8389-a90a-4ce5-a897-52591f54b0f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:51.741810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da19a5eacb4146bd870c991bb48987a6', 'request_id': 'req-185f8389-a90a-4ce5-a897-52591f54b0f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:51.774664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] The token cache is being invalidate because project da19a5eacb4146bd870c991bb48987a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:48:51.775078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:51.777140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-185f8389-a90a-4ce5-a897-52591f54b0f7 tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:51.779435 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1200/2428] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:48:51 2022] DELETE /identity/v3/projects/da19a5eacb4146bd870c991bb48987a6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:52.001273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:52.003371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:52.070396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd7d6-0526-437c-90e2-2706e2fae81b tempest-VolumeQuotaClassesTest-1383547291 tempest-VolumeQuotaClassesTest-1383547291-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:52.117583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:52.142895 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:52.144251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:52.144962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:52.145556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] PATH_INFO: `/v3/users/0ca94ad10cfa42359678037d4c621ed0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:52.147577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca94ad10cfa42359678037d4c621ed0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:52.150928 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:52.206499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca94ad10cfa42359678037d4c621ed0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:52.223595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca94ad10cfa42359678037d4c621ed0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:52.230867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca94ad10cfa42359678037d4c621ed0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:52.231482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca94ad10cfa42359678037d4c621ed0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:52.239193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca94ad10cfa42359678037d4c621ed0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:52.245513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1229/2429] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:48:52 2022] DELETE /identity/v3/users/0ca94ad10cfa42359678037d4c621ed0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:52.250831 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:52.251271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:52.251682 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:52.277770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:52.280140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:52.353486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1201/2430] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:48:52.364719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:52.366419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:52.433270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e22d4b-61f5-48fd-8279-0af84d41c6f6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:52.437460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115bb52-1b92-4c83-b11b-f9bc13e136b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:52.438122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115bb52-1b92-4c83-b11b-f9bc13e136b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:52.438401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115bb52-1b92-4c83-b11b-f9bc13e136b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:52.438675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115bb52-1b92-4c83-b11b-f9bc13e136b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:52.448290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115bb52-1b92-4c83-b11b-f9bc13e136b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:52.449743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115bb52-1b92-4c83-b11b-f9bc13e136b0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:52.460474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1230/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:52.984687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:52.986505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:53.000326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ec84-4b2b-42a7-ad8a-029e7100aa17 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:53.008881 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.009556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:53.009996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.010694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.010905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.011518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.011518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] PATH_INFO: `/v3/projects/bf61824b3de940a3a58865e78decc8ce` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.012818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf61824b3de940a3a58865e78decc8ce)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:53.015302 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:53.035317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] MFA Rules not processed for user `bfa74308096d40daac0a67c9ebec8d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:53.036740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:53.070588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf61824b3de940a3a58865e78decc8ce', 'request_id': 'req-1442a852-3631-46b6-88b6-3420b0c6e0c9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.077911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf61824b3de940a3a58865e78decc8ce', 'request_id': 'req-1442a852-3631-46b6-88b6-3420b0c6e0c9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.083854 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf61824b3de940a3a58865e78decc8ce', 'request_id': 'req-1442a852-3631-46b6-88b6-3420b0c6e0c9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.098132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] The token cache is being invalidate because project bf61824b3de940a3a58865e78decc8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:48:53.098423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.099052 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.101027 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1202/2432] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:48:52 2022] DELETE /identity/v3/projects/bf61824b3de940a3a58865e78decc8ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:53.105642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:53.106542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1231/2433] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:53.110018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:53.151581 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:53.193271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442a852-3631-46b6-88b6-3420b0c6e0c9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:53.197963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:53.198860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.199136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.199555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] PATH_INFO: `/v3/users/ca1b24c1cc154f798a43ae5371c9bc51` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.200836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1b24c1cc154f798a43ae5371c9bc51)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:53.203035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:53.254740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1b24c1cc154f798a43ae5371c9bc51'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.267176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1b24c1cc154f798a43ae5371c9bc51'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.276007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1b24c1cc154f798a43ae5371c9bc51'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.276832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1b24c1cc154f798a43ae5371c9bc51'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.277570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a5e3fea0-e8e6-4f44-a125-70c3fdb1959f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1b24c1cc154f798a43ae5371c9bc51'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.292211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1203/2434] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:48:53 2022] DELETE /identity/v3/users/ca1b24c1cc154f798a43ae5371c9bc51 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:48:53.606249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:53.619827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382a420-a921-434c-9b93-23630fec52e1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:53.633299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:53.693291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:53.695372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.695718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.696028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] PATH_INFO: `/v3/projects/98d40b4924444d608a263e9960cd7693` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.697337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d40b4924444d608a263e9960cd7693)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:53.699302 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:53.752921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d40b4924444d608a263e9960cd7693', 'request_id': 'req-96812773-275a-4c9a-823d-aac42c60d4c0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.760458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d40b4924444d608a263e9960cd7693', 'request_id': 'req-96812773-275a-4c9a-823d-aac42c60d4c0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.766807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d40b4924444d608a263e9960cd7693', 'request_id': 'req-96812773-275a-4c9a-823d-aac42c60d4c0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.780690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] The token cache is being invalidate because project 98d40b4924444d608a263e9960cd7693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:48:53.781047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.781740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-96812773-275a-4c9a-823d-aac42c60d4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:48:53.783386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1232/2435] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:48:53 2022] DELETE /identity/v3/projects/98d40b4924444d608a263e9960cd7693 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:53.788500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.788791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.789073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.807019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:53.808852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:53.868775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1204/2436] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:53.877144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.877520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.877875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.897934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:53.899375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:53.908205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1233/2437] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:53.912508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:53.923165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c072ea5-05e6-4eda-b9e5-8ffee0cfd0a7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:53.927732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:53.928432 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.928722 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.929004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.929740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:48:53.930055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:53.931664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:53.943932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1205/2438] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:48:53.948197 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:53.958063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e95b4-1197-4a87-be3e-bb632538f2f8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:53.964511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:53.965202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:53.965488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:53.965790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:53.966459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:53.974832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.006886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1234/2439] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:53 2022] POST /identity/v3/projects => generated 407 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:54.007864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.022161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982059ff-4eb6-4e6e-90c7-a94e2d34555c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.066345 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:54.095157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.095850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.096144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.096430 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.097136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.099073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.122745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1206/2440] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:48:54 2022] POST /identity/v3/users => generated 304 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:54.128933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.139642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc76d-c62c-4ff0-8874-37b7828fc10c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.144416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.145110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.145368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.145648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.146372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.148052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.159725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1235/2441] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:54.164209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.174930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46529c28-0998-4640-b48b-59ff66d111da admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.179918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a67f7-5203-43f9-8b3e-844ec5ce163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.180587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a67f7-5203-43f9-8b3e-844ec5ce163e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.180876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a67f7-5203-43f9-8b3e-844ec5ce163e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.181182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a67f7-5203-43f9-8b3e-844ec5ce163e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.181921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a67f7-5203-43f9-8b3e-844ec5ce163e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.183526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a67f7-5203-43f9-8b3e-844ec5ce163e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.194064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1207/2442] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:54.198101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.209738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fed54-3aa9-4330-aff0-b58a1a4e86e4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.215127 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.216146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.216640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.217716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] PATH_INFO: `/v3/projects/a1454d4b49d54ca699223aa693968487/users/270ecfd18cd64f05b43fda1eca931d44/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.233865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1454d4b49d54ca699223aa693968487, user_id=270ecfd18cd64f05b43fda1eca931d44, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.236634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.251351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1236/2443] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:54 2022] PUT /identity/v3/projects/a1454d4b49d54ca699223aa693968487/users/270ecfd18cd64f05b43fda1eca931d44/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:54.261702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.262000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.262282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.291151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] MFA Rules not processed for user `270ecfd18cd64f05b43fda1eca931d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:54.292606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:54.362786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1208/2444] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:54.367561 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.413749 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:54.437677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d9415-c12f-45a8-8e34-41e8b252b5b6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.442701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.443369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.443688 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.444001 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.444769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.446719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.474632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1237/2445] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:48:54 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:54.479491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.495103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c4d0-8f7f-4d0e-a373-2ad69ca1d2cd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.564496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.565179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.565487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.565813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.566522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.568836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.595268 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1209/2446] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:48:54 2022] POST /identity/v3/users => generated 311 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:48:54.598484 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.612052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32217e87-cc3a-46bf-bcd2-c91579bcc801 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.617599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.618384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.619014 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.619303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.620077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.621719 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.634338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1238/2447] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:54.638547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.650024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4f72f-db20-4b73-8058-4f3f1ebb7979 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.656580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.657770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.658191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.658553 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] PATH_INFO: `/v3/projects/31e871644ea449688833dd6b44af31c0/users/0c50c5d28bae44aab9d331e1db8008b0/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.675732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e871644ea449688833dd6b44af31c0, user_id=0c50c5d28bae44aab9d331e1db8008b0, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.678500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.693598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1210/2448] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:54 2022] PUT /identity/v3/projects/31e871644ea449688833dd6b44af31c0/users/0c50c5d28bae44aab9d331e1db8008b0/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:48:54.697632 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.708072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dd51f-eb33-4ae7-bbfa-1d09c51e2b69 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.772892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2856f-70ca-447f-9151-dd19636f6269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.773634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2856f-70ca-447f-9151-dd19636f6269 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.773634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2856f-70ca-447f-9151-dd19636f6269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.773634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2856f-70ca-447f-9151-dd19636f6269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.774390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2856f-70ca-447f-9151-dd19636f6269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.776109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2856f-70ca-447f-9151-dd19636f6269 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.787219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1239/2449] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:48:54.791594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.805151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32666042-d3ae-4117-b58e-931c8c01e3f0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:54.809805 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:54.811298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.811590 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.811946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] PATH_INFO: `/v3/projects/31e871644ea449688833dd6b44af31c0/users/0c50c5d28bae44aab9d331e1db8008b0/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.813927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e871644ea449688833dd6b44af31c0, user_id=0c50c5d28bae44aab9d331e1db8008b0, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:54.816689 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:54.819755 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:54.829277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1211/2450] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:48:54 2022] PUT /identity/v3/projects/31e871644ea449688833dd6b44af31c0/users/0c50c5d28bae44aab9d331e1db8008b0/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:48:54.839564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:54.839903 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:54.840181 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:54.866059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] MFA Rules not processed for user `0c50c5d28bae44aab9d331e1db8008b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:48:54.867289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:54.936646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1240/2451] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:48:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:48:54.947792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:54.949479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:55.017660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353cf9-9aa8-4fcc-8a8f-4f2d4d6f4e33 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:55.024170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:55.026224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:55.026568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:55.026925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:55.039933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:55.041514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:55.054159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1212/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:55.227610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:55.237154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa1f7c-c4d6-4820-8f29-c6ad50f5a5c3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:55.241131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:55.241794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:55.242077 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:55.242348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:55.277107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:55.304331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:55.306290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:55.316949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1241/2453] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:48:56.536549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:48:56.538771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:56.640400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74dcb2-8799-45c0-b2a7-3780bbacb187 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:48:56.646188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:48:56.646926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:48:56.647287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:48:56.647640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:48:56.649638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:48:56.666490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:48:56.668167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:48:56.682014 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1213/2454] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:48:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:49:05.312740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=12 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:05.794057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:05.872660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191bda2-f36f-47b0-b741-9fe13d5e89ee service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:05.880133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:05.881806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:05.882438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:05.882887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] PATH_INFO: `/v3/users/270ecfd18cd64f05b43fda1eca931d44` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:05.884388 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270ecfd18cd64f05b43fda1eca931d44)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:05.887999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:05.893995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:05.896309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:05.949201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270ecfd18cd64f05b43fda1eca931d44'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:05.966748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270ecfd18cd64f05b43fda1eca931d44'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:05.976045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0237d2-d1f9-430a-a201-9409af67a234 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:05.978069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270ecfd18cd64f05b43fda1eca931d44'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:05.979204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270ecfd18cd64f05b43fda1eca931d44'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:05.980606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:05.981458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:05.982210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:05.982639 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:05.984898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:05.988164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e729382a-8ded-4dfe-afea-ead323d5cfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270ecfd18cd64f05b43fda1eca931d44'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:05.995512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1242/2455] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:05 2022] DELETE /identity/v3/users/270ecfd18cd64f05b43fda1eca931d44 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:06.000537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:06.000901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:06.001190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:06.021377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:06.022586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:06.035373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:06.090652 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:06.092170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:06.107550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1243/2456] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:49:06.113380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1214/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:06.114164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:06.115584 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:06.137760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:06.177145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9adf75-bc31-485c-beb9-bb36f3a1902e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:06.180731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:06.181450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:06.181805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:06.182110 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:06.192267 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:06.193643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:06.202899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1244/2458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:49:06.508913 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:06.512956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:06.533292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e890085-4084-43c0-b439-aa765e13d955 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:06.540229 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:06.541922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:06.542211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:06.542488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] PATH_INFO: `/v3/projects/a1454d4b49d54ca699223aa693968487` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:06.544192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1454d4b49d54ca699223aa693968487)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:06.548379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:06.618901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1454d4b49d54ca699223aa693968487', 'request_id': 'req-12be7f93-8e33-425c-8e97-03a70f0467cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.626298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1454d4b49d54ca699223aa693968487', 'request_id': 'req-12be7f93-8e33-425c-8e97-03a70f0467cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.632734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1454d4b49d54ca699223aa693968487', 'request_id': 'req-12be7f93-8e33-425c-8e97-03a70f0467cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.646669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] The token cache is being invalidate because project a1454d4b49d54ca699223aa693968487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:06.647092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.647887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.649524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1215/2459] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:06 2022] DELETE /identity/v3/projects/a1454d4b49d54ca699223aa693968487 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:06.653640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:06.666041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b7a94-9528-4608-9c9f-667906ca3b62 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:06.735815 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:06.736731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:06.737018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:06.737296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] PATH_INFO: `/v3/users/0c50c5d28bae44aab9d331e1db8008b0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:06.738589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c50c5d28bae44aab9d331e1db8008b0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:06.740641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:06.807819 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c50c5d28bae44aab9d331e1db8008b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.822273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c50c5d28bae44aab9d331e1db8008b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.833823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c50c5d28bae44aab9d331e1db8008b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.834519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c50c5d28bae44aab9d331e1db8008b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.843285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3fffe605-ea3c-4d34-8243-fd0c49cf0053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c50c5d28bae44aab9d331e1db8008b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:06.853729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1245/2460] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:06 2022] DELETE /identity/v3/users/0c50c5d28bae44aab9d331e1db8008b0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:07.265910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.267627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:07.286250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7f93-8e33-425c-8e97-03a70f0467cd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.345896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.346811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.347085 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.347359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] PATH_INFO: `/v3/projects/31e871644ea449688833dd6b44af31c0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.348588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e871644ea449688833dd6b44af31c0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.350709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.410093 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:07.422691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e871644ea449688833dd6b44af31c0', 'request_id': 'req-ac9a875f-33cb-455a-b12f-52857729b600'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:07.429169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e871644ea449688833dd6b44af31c0', 'request_id': 'req-ac9a875f-33cb-455a-b12f-52857729b600'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:07.434953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e871644ea449688833dd6b44af31c0', 'request_id': 'req-ac9a875f-33cb-455a-b12f-52857729b600'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:07.448552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] The token cache is being invalidate because project 31e871644ea449688833dd6b44af31c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:07.448777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:07.449613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ac9a875f-33cb-455a-b12f-52857729b600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:07.451196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1216/2461] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:07 2022] DELETE /identity/v3/projects/31e871644ea449688833dd6b44af31c0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:07.456442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.457266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.457592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.478219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:07.479525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:07.520904 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:07.545019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1246/2462] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:07.553946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.554239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.554518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.575355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:07.576605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:07.585421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1217/2463] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:07.590173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.601004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9582ed-aad5-4a54-90be-a1e01a752d41 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.606805 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.607255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.607571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.607976 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.608886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:07.609377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.611370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.623315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1247/2464] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:07.628381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.637717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439d36-054f-4af7-90d3-57a038a0ecf9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.644711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.645403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.645695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.645973 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.646786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.648769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.681951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1218/2465] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:07 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:07.683221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.700509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a02e8-e868-4d4a-82b2-0db48ce913b4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.771320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.771320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.771320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.771320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.771958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.771958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.792237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1248/2466] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:07 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:07.796612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.807064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8fc8-66d7-4b66-86be-3af0ecdd754e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.811711 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.812401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.812683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.812960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.813686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.815304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.825735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1219/2467] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:07.830631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.841048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36992ccb-51bc-4457-ad0a-619909185108 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.846611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058476a-d185-47ca-bb3b-20aca8379fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.847279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058476a-d185-47ca-bb3b-20aca8379fce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.847566 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058476a-d185-47ca-bb3b-20aca8379fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.847867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058476a-d185-47ca-bb3b-20aca8379fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.848666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058476a-d185-47ca-bb3b-20aca8379fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.850299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058476a-d185-47ca-bb3b-20aca8379fce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.863986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1249/2468] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:49:07.865193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:07.875718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395374-e5be-4c88-930c-66ddadbb338f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:07.880620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:07.881502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.881836 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.882112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] PATH_INFO: `/v3/projects/54eb153c973244f5bff1a51b64ce2d97/users/e5d7e1eaae444ba0a3d7f6229dc9ba24/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.896763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54eb153c973244f5bff1a51b64ce2d97, user_id=e5d7e1eaae444ba0a3d7f6229dc9ba24, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:07.899455 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:07.914204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1220/2469] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:07 2022] PUT /identity/v3/projects/54eb153c973244f5bff1a51b64ce2d97/users/e5d7e1eaae444ba0a3d7f6229dc9ba24/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:07.925898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:07.926184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:07.926470 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:07.960913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] MFA Rules not processed for user `e5d7e1eaae444ba0a3d7f6229dc9ba24`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:07.962104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:08.041906 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1250/2470] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:08.046756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.116342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e544f-0bc8-4bba-99d2-fc6eef1e0f66 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.121194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.121964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.122321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.122667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.123470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.126138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.163555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1221/2471] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:08 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:49:08.165612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.177988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c418496-2455-4e5e-aa3d-703566e2ea34 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.250132 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:08.284840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.286038 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.286495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.287198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.288086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.290392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.318609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1251/2472] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:08 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:08.323049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.337992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29c7c-4f42-41e9-b016-eb574a32e193 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.350867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.352056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.352555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.353055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.353992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.355761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.371876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1222/2473] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:08.374025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.384260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688c52e-b9eb-46f6-93bd-f6f7c44b72ab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.388937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.390364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.390645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.390925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] PATH_INFO: `/v3/projects/11adb65ff05b4ff3a5033f391ce46ac0/users/aae2ddbf15ff4a3a9a2755446c55bf96/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.407766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11adb65ff05b4ff3a5033f391ce46ac0, user_id=aae2ddbf15ff4a3a9a2755446c55bf96, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.410506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.423469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1252/2474] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:08 2022] PUT /identity/v3/projects/11adb65ff05b4ff3a5033f391ce46ac0/users/aae2ddbf15ff4a3a9a2755446c55bf96/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:08.427544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.437400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d10160-b065-4baf-9545-42a3a8011eb7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.469334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:08.497864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca8370-d35a-4262-950f-f3a4e3893067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.498537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8370-d35a-4262-950f-f3a4e3893067 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.498901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8370-d35a-4262-950f-f3a4e3893067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.499289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8370-d35a-4262-950f-f3a4e3893067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.500190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca8370-d35a-4262-950f-f3a4e3893067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.501813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca8370-d35a-4262-950f-f3a4e3893067 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.515716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1223/2475] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:08.516849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.527823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855123a3-7aa6-41c9-a310-24ca1be2192d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.533759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.534707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.534994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.535270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] PATH_INFO: `/v3/projects/11adb65ff05b4ff3a5033f391ce46ac0/users/aae2ddbf15ff4a3a9a2755446c55bf96/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.537279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11adb65ff05b4ff3a5033f391ce46ac0, user_id=aae2ddbf15ff4a3a9a2755446c55bf96, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.540022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.551133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1253/2476] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:08 2022] PUT /identity/v3/projects/11adb65ff05b4ff3a5033f391ce46ac0/users/aae2ddbf15ff4a3a9a2755446c55bf96/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:08.561482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.561804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.562185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.589807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] MFA Rules not processed for user `aae2ddbf15ff4a3a9a2755446c55bf96`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:08.591069 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:08.662187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1224/2477] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:08.673106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:08.674852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:08.734498 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b036b7-8390-4e2b-b039-682853a6fe37 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:08.739861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dad5b-dc5f-41e9-8438-5a1623664dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:08.740517 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dad5b-dc5f-41e9-8438-5a1623664dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:08.740806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dad5b-dc5f-41e9-8438-5a1623664dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:08.741086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dad5b-dc5f-41e9-8438-5a1623664dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:08.755380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dad5b-dc5f-41e9-8438-5a1623664dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:08.755380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dad5b-dc5f-41e9-8438-5a1623664dc5 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:08.768162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1254/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:09.154763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:09.216661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67aa3-98b4-443b-bd25-dc527b54775f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:09.221135 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:09.221992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:09.222275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:09.222549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] PATH_INFO: `/v3/users/e5d7e1eaae444ba0a3d7f6229dc9ba24` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:09.223775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d7e1eaae444ba0a3d7f6229dc9ba24)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:09.225717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:09.271670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d7e1eaae444ba0a3d7f6229dc9ba24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.278644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:09.285259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d7e1eaae444ba0a3d7f6229dc9ba24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.292261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d7e1eaae444ba0a3d7f6229dc9ba24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.292860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d7e1eaae444ba0a3d7f6229dc9ba24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.293480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d7e1eaae444ba0a3d7f6229dc9ba24'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.305940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1225/2479] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:09 2022] DELETE /identity/v3/users/e5d7e1eaae444ba0a3d7f6229dc9ba24 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:09.310441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:09.310727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:09.311026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:09.328442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:09.329634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:09.393402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1255/2480] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:09.410641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:09.412231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:09.495000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871207c-7eb1-4085-9f31-e9d983e77931 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:09.498953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:09.500186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:09.500474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:09.500762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:09.510523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:09.512005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:09.522254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1226/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:09.791465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:09.792994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:09.805158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80185fdb-985d-4571-b18d-db0c58bdc923 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:09.810246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:09.811188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:09.812190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:09.812482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] PATH_INFO: `/v3/projects/54eb153c973244f5bff1a51b64ce2d97` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:09.814352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54eb153c973244f5bff1a51b64ce2d97)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:09.816329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:09.848644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:09.865343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54eb153c973244f5bff1a51b64ce2d97', 'request_id': 'req-7f94f4a6-7505-435a-9f61-79eb22e1666c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.871619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54eb153c973244f5bff1a51b64ce2d97', 'request_id': 'req-7f94f4a6-7505-435a-9f61-79eb22e1666c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.878348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54eb153c973244f5bff1a51b64ce2d97', 'request_id': 'req-7f94f4a6-7505-435a-9f61-79eb22e1666c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.890232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] The token cache is being invalidate because project 54eb153c973244f5bff1a51b64ce2d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:09.890523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.891146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:09.892691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1256/2482] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:09 2022] DELETE /identity/v3/projects/54eb153c973244f5bff1a51b64ce2d97 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:09.896708 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:09.907182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200766fc-a1ea-4073-8d75-d44264b87334 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:09.963374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:09.964276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:09.964559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:09.964835 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] PATH_INFO: `/v3/users/aae2ddbf15ff4a3a9a2755446c55bf96` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:09.966042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae2ddbf15ff4a3a9a2755446c55bf96)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:09.968151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.012961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae2ddbf15ff4a3a9a2755446c55bf96'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.024812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae2ddbf15ff4a3a9a2755446c55bf96'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.033203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae2ddbf15ff4a3a9a2755446c55bf96'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.033885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae2ddbf15ff4a3a9a2755446c55bf96'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.034497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-75ea058f-1648-4670-984d-182e02c37a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae2ddbf15ff4a3a9a2755446c55bf96'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.040829 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:10.049646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1227/2483] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:09 2022] DELETE /identity/v3/users/aae2ddbf15ff4a3a9a2755446c55bf96 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:10.312214 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.313648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:10.326799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f4a6-7505-435a-9f61-79eb22e1666c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.388670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.389692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.389981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.390263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] PATH_INFO: `/v3/projects/11adb65ff05b4ff3a5033f391ce46ac0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.391497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11adb65ff05b4ff3a5033f391ce46ac0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.393499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.442366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11adb65ff05b4ff3a5033f391ce46ac0', 'request_id': 'req-f6d4a90b-c8f7-42c3-b133-de1163b83e28'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.448393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11adb65ff05b4ff3a5033f391ce46ac0', 'request_id': 'req-f6d4a90b-c8f7-42c3-b133-de1163b83e28'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.454459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11adb65ff05b4ff3a5033f391ce46ac0', 'request_id': 'req-f6d4a90b-c8f7-42c3-b133-de1163b83e28'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.468152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] The token cache is being invalidate because project 11adb65ff05b4ff3a5033f391ce46ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:10.468528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.469199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f6d4a90b-c8f7-42c3-b133-de1163b83e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:10.471116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1257/2484] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:10 2022] DELETE /identity/v3/projects/11adb65ff05b4ff3a5033f391ce46ac0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:10.475810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.476342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.476441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.497206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:10.497575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:10.580792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1228/2485] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:10.588314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.588621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.588994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.616338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:10.617564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:10.626690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1258/2486] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:10.631400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.642462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e7b61-6c49-40f5-a7f6-da4968010aef None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.647720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.648465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.648745 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.649018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.649751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:10.650063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.651673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.664757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1229/2487] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:10.669367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.678682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00b12e-e521-40f8-aa57-411661b8f4bc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.683279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.683960 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.684252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.684527 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.685220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.687207 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.713459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1259/2488] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:10 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:10.718416 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.728146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6ab3-6ee7-479e-8a18-4f71d7784696 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.791476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.792277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.792565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.792841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.793541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.795472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.817437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1230/2489] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:10 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:49:10.821870 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.835400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b7cd-6b80-4b93-b330-17f09e29797f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.843544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.844690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.845040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.845420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.846202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.847886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.858502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1260/2490] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:10.862647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.872774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96e24c-fe25-4cc8-a598-73e1e708327b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.878287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e831c-5d32-4208-ae44-cf07e57aa56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.878932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e831c-5d32-4208-ae44-cf07e57aa56c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.879217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e831c-5d32-4208-ae44-cf07e57aa56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.879495 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e831c-5d32-4208-ae44-cf07e57aa56c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.880257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e831c-5d32-4208-ae44-cf07e57aa56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.881848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e831c-5d32-4208-ae44-cf07e57aa56c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.892509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1231/2491] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:10.896499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:10.906425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451661-7be9-4739-af94-f5ae854ccf3c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:10.911016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:10.911914 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.912204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.912492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] PATH_INFO: `/v3/projects/acb5f182ade84b16986f83a5e6775e49/users/8d29798ac33d4a94ac16ebba83114a02/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.914674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:10.929283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb5f182ade84b16986f83a5e6775e49, user_id=8d29798ac33d4a94ac16ebba83114a02, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:10.932056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:10.945658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1261/2492] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:10 2022] PUT /identity/v3/projects/acb5f182ade84b16986f83a5e6775e49/users/8d29798ac33d4a94ac16ebba83114a02/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:10.955860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:10.956188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:10.956468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:10.985156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] MFA Rules not processed for user `8d29798ac33d4a94ac16ebba83114a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:10.986469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:11.033500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:11.050879 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1232/2493] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:11.062172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:11.063979 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:11.124784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4a241-c750-4c51-b126-115e1299772b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:11.128706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b01630-c95d-4472-ae2d-5d03783beb8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:11.129355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b01630-c95d-4472-ae2d-5d03783beb8a service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:11.129645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b01630-c95d-4472-ae2d-5d03783beb8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:11.129929 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b01630-c95d-4472-ae2d-5d03783beb8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:11.138184 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b01630-c95d-4472-ae2d-5d03783beb8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:11.140271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b01630-c95d-4472-ae2d-5d03783beb8a service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:11.149150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1262/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:11.167970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:11.229156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aace4-6363-4682-bdfc-073f13014842 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:11.233904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:11.234777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:11.235053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:11.235331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] PATH_INFO: `/v3/users/8d29798ac33d4a94ac16ebba83114a02` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:11.236552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d29798ac33d4a94ac16ebba83114a02)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:11.238483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:11.283786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d29798ac33d4a94ac16ebba83114a02'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.295246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d29798ac33d4a94ac16ebba83114a02'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.302878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d29798ac33d4a94ac16ebba83114a02'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.303517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d29798ac33d4a94ac16ebba83114a02'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.304160 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d29798ac33d4a94ac16ebba83114a02'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.315969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1233/2495] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:11 2022] DELETE /identity/v3/users/8d29798ac33d4a94ac16ebba83114a02 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:11.320586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:11.320878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:11.321158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:11.338598 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:11.339724 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:11.398088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1263/2496] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:11.408320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:11.409697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:11.466153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a01ce1-fc59-413a-b03e-468a20a26ee2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:11.470612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93548-1f25-4193-8c77-0b3cda3876d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:11.471240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93548-1f25-4193-8c77-0b3cda3876d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:11.471520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93548-1f25-4193-8c77-0b3cda3876d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:11.471792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93548-1f25-4193-8c77-0b3cda3876d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:11.480715 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93548-1f25-4193-8c77-0b3cda3876d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:11.482149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93548-1f25-4193-8c77-0b3cda3876d6 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:11.491858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1234/2497] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:11.828125 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:11.829629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:11.841884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdb638-8c11-42f8-88a8-359a28094782 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:11.847421 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:11.848336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:11.848674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:11.848957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] PATH_INFO: `/v3/projects/acb5f182ade84b16986f83a5e6775e49` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:11.850151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb5f182ade84b16986f83a5e6775e49)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:11.853822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:11.913296 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb5f182ade84b16986f83a5e6775e49', 'request_id': 'req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.919569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb5f182ade84b16986f83a5e6775e49', 'request_id': 'req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.925943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb5f182ade84b16986f83a5e6775e49', 'request_id': 'req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.940397 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] The token cache is being invalidate because project acb5f182ade84b16986f83a5e6775e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:11.940769 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.941469 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03fdd0b2-96cb-4859-a257-62c8cfd9dea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:11.946529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1264/2498] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:11 2022] DELETE /identity/v3/projects/acb5f182ade84b16986f83a5e6775e49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:11.948442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:11.948813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:11.949170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:11.966746 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:11.968743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:11.977272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:12.033210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1235/2499] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:12.041813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.042111 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.042398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.060558 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:12.062163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:12.070099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1265/2500] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:12.074311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.085332 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d33687-df13-4d41-aca6-690e04bed0fc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.090192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.090859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.091145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.091425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.092262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:12.092654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.094864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.112058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1236/2501] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:12.116788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.121186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:12.129780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f136b-1b2a-4d14-90f0-fffb1529ded3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.136106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.136737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.137028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.137319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.138032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.140332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.169045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1266/2502] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:12 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:12.173907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.184761 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394a45-e16b-4e8d-a174-836717aac751 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.249618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.250290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.250577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.250857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.251555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.253798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.272928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1237/2503] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:12 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:12.277161 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.287624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34284d-5d31-47e8-8deb-fee3998546f2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.292178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.292828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.293114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.293392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.294113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.296367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.307479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1267/2504] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:49:12.312059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.321832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed810-dc30-4498-8272-3026ed998021 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.326519 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d952c-5f6b-4ece-a059-429a2afb7318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.327169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d952c-5f6b-4ece-a059-429a2afb7318 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.327559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d952c-5f6b-4ece-a059-429a2afb7318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.327880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d952c-5f6b-4ece-a059-429a2afb7318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.328621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d952c-5f6b-4ece-a059-429a2afb7318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.330215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d952c-5f6b-4ece-a059-429a2afb7318 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.340045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1238/2505] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:49:12.344122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.353922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085879a-f967-4ecd-9aeb-c1a47fb25e0d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.358944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.359982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.360264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.360533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] PATH_INFO: `/v3/projects/d9e6cd844d854230a480f0701cd6d532/users/fd8fda1c1cc24e829c438538bf73f521/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.375213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e6cd844d854230a480f0701cd6d532, user_id=fd8fda1c1cc24e829c438538bf73f521, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.378246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.391455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1268/2506] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:12 2022] PUT /identity/v3/projects/d9e6cd844d854230a480f0701cd6d532/users/fd8fda1c1cc24e829c438538bf73f521/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:12.401439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.401740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.402022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.428458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] MFA Rules not processed for user `fd8fda1c1cc24e829c438538bf73f521`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:12.429683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:12.495057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1239/2507] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:49:12.507887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:12.510148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:12.568655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf92e7-d62a-40bf-9d89-740c81d1938f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:12.572386 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:12.573030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:12.573317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:12.573595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:12.583328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:12.584811 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:12.595674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1269/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:16.508199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:16.509647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:16.521133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:16.587493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f817-87a8-4ed7-a4ca-dd374c6a9b24 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:16.594798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:16.595451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:16.595736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:16.596042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:16.597874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:16.610893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:16.612552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e5e8-bdbb-4b04-914d-28d5ce35c579 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:16.623537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1240/2509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:20.861946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:20.923622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e91e-596c-4ba2-956f-77111c57553c service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:20.928227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:20.929096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:20.929384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:20.929661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] PATH_INFO: `/v3/users/fd8fda1c1cc24e829c438538bf73f521` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:20.930866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8fda1c1cc24e829c438538bf73f521)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:20.932880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:20.976779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8fda1c1cc24e829c438538bf73f521'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:20.978627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:20.991543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8fda1c1cc24e829c438538bf73f521'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:20.998103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8fda1c1cc24e829c438538bf73f521'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:20.998759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8fda1c1cc24e829c438538bf73f521'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.005875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8fda1c1cc24e829c438538bf73f521'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.011641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1270/2510] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:20 2022] DELETE /identity/v3/users/fd8fda1c1cc24e829c438538bf73f521 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:21.016683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:21.017143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:21.017262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:21.034859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:21.036032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:21.094117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1241/2511] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:21.106259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:21.107676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:21.170221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c778-5e70-4d0f-be10-a25325240104 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:21.174048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:21.176981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:21.176981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:21.176981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:21.184827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:21.186295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:21.186883 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:21.196227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1271/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:21.196635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699b15-64dd-4d62-838d-5eb78e85137f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:21.200394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:21.201124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:21.201479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:21.202344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:21.204320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:21.219644 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:21.221125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:21.231298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1242/2513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:49:21.773192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:21.774799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:21.788999 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b6b7a-5573-4f1b-83fa-69cdbcf671bb service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:21.793732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:21.794743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:21.795042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:21.795318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] PATH_INFO: `/v3/projects/d9e6cd844d854230a480f0701cd6d532` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:21.796585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e6cd844d854230a480f0701cd6d532)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:21.798537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:21.852891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e6cd844d854230a480f0701cd6d532', 'request_id': 'req-cf729616-cb91-476c-b832-65bd3a67e044'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.860964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e6cd844d854230a480f0701cd6d532', 'request_id': 'req-cf729616-cb91-476c-b832-65bd3a67e044'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.867922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e6cd844d854230a480f0701cd6d532', 'request_id': 'req-cf729616-cb91-476c-b832-65bd3a67e044'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.882511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] The token cache is being invalidate because project d9e6cd844d854230a480f0701cd6d532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:21.882849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.883593 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:21.885709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1272/2514] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:21 2022] DELETE /identity/v3/projects/d9e6cd844d854230a480f0701cd6d532 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:24.651267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:24.652787 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:24.670529 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f15175-28dd-40ca-9ba3-09c5aa3e3b01 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:24.757204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:24.758120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:24.758408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:24.758688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] PATH_INFO: `/v3/users/8978ed54252843f78b0d00d37b475ad2` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:24.760047 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8978ed54252843f78b0d00d37b475ad2)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:24.762381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:24.790167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:24.817563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8978ed54252843f78b0d00d37b475ad2'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:24.830083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8978ed54252843f78b0d00d37b475ad2'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:24.837341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8978ed54252843f78b0d00d37b475ad2'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:24.837958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8978ed54252843f78b0d00d37b475ad2'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:24.838558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-885300c7-a3eb-406e-bad9-88d2d227beec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8978ed54252843f78b0d00d37b475ad2'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:24.851646 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1243/2515] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:24 2022] DELETE /identity/v3/users/8978ed54252843f78b0d00d37b475ad2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:25.033053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.035238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:25.050767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf729616-cb91-476c-b832-65bd3a67e044 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.101537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:25.113451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.114351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.114636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.114916 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] PATH_INFO: `/v3/projects/bd1ef211ea584b0abd50b02208966d7a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.116198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1ef211ea584b0abd50b02208966d7a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.118779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.168864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1ef211ea584b0abd50b02208966d7a', 'request_id': 'req-175b7f45-5407-4f25-aa0c-9f66ece2f084'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:25.175543 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1ef211ea584b0abd50b02208966d7a', 'request_id': 'req-175b7f45-5407-4f25-aa0c-9f66ece2f084'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:25.182586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1ef211ea584b0abd50b02208966d7a', 'request_id': 'req-175b7f45-5407-4f25-aa0c-9f66ece2f084'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:25.199299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] The token cache is being invalidate because project bd1ef211ea584b0abd50b02208966d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:25.199591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:25.200233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-175b7f45-5407-4f25-aa0c-9f66ece2f084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:25.202816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1273/2516] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:25 2022] DELETE /identity/v3/projects/bd1ef211ea584b0abd50b02208966d7a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:25.207179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.207475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.207757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.226427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:25.227620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:25.294232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1244/2517] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:25.303085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.303377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.304121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.322823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:25.324087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:25.332673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1274/2518] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:25.337049 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.347357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e53a-88ff-4e3f-8313-3611593267da None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.352092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.352747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.353026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.353304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.354031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:25.354336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.355965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.368267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1245/2519] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:25.372534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.382927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e9c0-2707-47f7-8039-f03d25adf282 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.387713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.388481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.388770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.389054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.390271 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.392308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.420189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1275/2520] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:25.424292 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.434255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328ff5-9d86-4220-8aa4-ffbd918b58f3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.494461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.495129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.495412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.495686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.496399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.498312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.518940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1246/2521] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:25.523018 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.534136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b6a3-cf49-4ff0-8b64-dde2c6f2422d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.538775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.539440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.539732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.540037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.540766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.542389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.552733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1276/2522] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:25.556533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.567156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1474d-3469-4d00-b5ba-3af560bc1676 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.571824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e8bbb-6591-4915-bb32-3f55e2028715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.572503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e8bbb-6591-4915-bb32-3f55e2028715 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.572794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e8bbb-6591-4915-bb32-3f55e2028715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.573107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e8bbb-6591-4915-bb32-3f55e2028715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.573839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e8bbb-6591-4915-bb32-3f55e2028715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.575444 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e8bbb-6591-4915-bb32-3f55e2028715 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.586046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1247/2523] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:25.590394 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.601628 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66ac3f-47cf-48b3-810f-998a6b2e6885 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.606391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.607277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.607565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.607867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] PATH_INFO: `/v3/projects/c3477448770245bd899e5aa590c3663b/users/96db203db2674356b3e89e500d0bdf94/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.622186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3477448770245bd899e5aa590c3663b, user_id=96db203db2674356b3e89e500d0bdf94, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.625600 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.638816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1277/2524] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:25 2022] PUT /identity/v3/projects/c3477448770245bd899e5aa590c3663b/users/96db203db2674356b3e89e500d0bdf94/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:25.651998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.652511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.652634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.666812 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:25.682081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] MFA Rules not processed for user `96db203db2674356b3e89e500d0bdf94`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:25.683233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:25.749117 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1248/2525] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:49:25.754315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.817412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68e96e-13de-4390-b790-cf556e73b9e3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.822151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.822809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.823099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.823381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.824117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.826070 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.853731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1278/2526] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:25.858019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.868700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580006e5-5ef6-4bfd-ab17-cda07369b245 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.924918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.925606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.925886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.926184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.926877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.928876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.948964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1249/2527] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:25 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:49:25.952974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.959624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:25.963479 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704e9b-e2d4-4a78-b3e9-d217a4c72671 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:25.969884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:25.970555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:25.971011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:25.971304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:25.972209 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:25.973861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:25.984944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1279/2528] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:25.988988 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:25.999700 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd279f01-045c-4526-865b-91a1e089f548 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:26.004824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:26.005705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:26.005990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:26.006262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] PATH_INFO: `/v3/projects/a0f15981b33e4bc29dfff832a9905cde/users/4e5afc5ed0b040e2aa0b884eee407065/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:26.020944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f15981b33e4bc29dfff832a9905cde, user_id=4e5afc5ed0b040e2aa0b884eee407065, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:26.023633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:26.036190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1250/2529] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:25 2022] PUT /identity/v3/projects/a0f15981b33e4bc29dfff832a9905cde/users/4e5afc5ed0b040e2aa0b884eee407065/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:26.040049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:26.050532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d6f2-1fbd-4762-bc2a-cc20044f18e1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:26.107522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be676cfb-a199-4737-90f8-ab5566bd666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:26.108919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676cfb-a199-4737-90f8-ab5566bd666c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:26.109370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676cfb-a199-4737-90f8-ab5566bd666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:26.109647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676cfb-a199-4737-90f8-ab5566bd666c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:26.110375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be676cfb-a199-4737-90f8-ab5566bd666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:26.112016 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be676cfb-a199-4737-90f8-ab5566bd666c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:26.121610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1280/2530] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:26.126376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:26.136818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8a04-da96-4588-8bf6-2930edeb8924 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:26.141478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:26.142356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:26.142643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:26.142919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] PATH_INFO: `/v3/projects/a0f15981b33e4bc29dfff832a9905cde/users/4e5afc5ed0b040e2aa0b884eee407065/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:26.144921 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f15981b33e4bc29dfff832a9905cde, user_id=4e5afc5ed0b040e2aa0b884eee407065, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:26.147641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:26.158095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1251/2531] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:26 2022] PUT /identity/v3/projects/a0f15981b33e4bc29dfff832a9905cde/users/4e5afc5ed0b040e2aa0b884eee407065/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:26.169275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:26.169685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:26.169973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:26.197009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] MFA Rules not processed for user `4e5afc5ed0b040e2aa0b884eee407065`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:26.198417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:26.268591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1281/2532] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:26 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:26.279762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:26.282048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:26.333778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:26.337792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc9b79-ae57-417d-bb84-08e4486aebe4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:26.342240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:26.342881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:26.343172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:26.344008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:26.353115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:26.354557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:26.364215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1252/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:26.436438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:26.446322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850a4a-927f-46ef-8122-c76f4c5b44f6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:26.450202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef73c2-cec9-4c17-ae95-1a28af103252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:26.450849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef73c2-cec9-4c17-ae95-1a28af103252 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:26.451138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef73c2-cec9-4c17-ae95-1a28af103252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:26.451419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef73c2-cec9-4c17-ae95-1a28af103252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:26.509796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef73c2-cec9-4c17-ae95-1a28af103252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:26.511348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef73c2-cec9-4c17-ae95-1a28af103252 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:26.521520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1282/2534] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:36.360405 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:36.516458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:48.748301 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:48.810389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bdc2-7b6f-43b6-99da-2d57aff86aab service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:48.815574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:48.816467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:48.816753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:48.817128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] PATH_INFO: `/v3/users/96db203db2674356b3e89e500d0bdf94` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:48.818351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] RBAC: Authorizing `identity:delete_user(user_id=96db203db2674356b3e89e500d0bdf94)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:48.820340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:48.865261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96db203db2674356b3e89e500d0bdf94'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:48.877548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96db203db2674356b3e89e500d0bdf94'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:48.885804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96db203db2674356b3e89e500d0bdf94'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:48.886472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96db203db2674356b3e89e500d0bdf94'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:48.887086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96db203db2674356b3e89e500d0bdf94'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:48.900009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1253/2535] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:48 2022] DELETE /identity/v3/users/96db203db2674356b3e89e500d0bdf94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:48.904423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:48.904908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:48.905023 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:48.922755 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:48.924137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:48.981523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1283/2536] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:48.991508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:48.992934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:49.050175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ecdd2-7842-4a64-90de-5ce454ceceff admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:49.053844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:49.054486 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:49.054776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:49.055064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:49.064855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:49.066235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:49.075592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1254/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:49.347808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:49.349682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:49.363940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16159f-26c9-4a1c-986b-f905b354a999 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:49.369381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:49.370258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:49.370620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:49.370959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] PATH_INFO: `/v3/projects/c3477448770245bd899e5aa590c3663b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:49.372091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3477448770245bd899e5aa590c3663b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:49.374245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:49.429007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3477448770245bd899e5aa590c3663b', 'request_id': 'req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.435494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3477448770245bd899e5aa590c3663b', 'request_id': 'req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.441825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3477448770245bd899e5aa590c3663b', 'request_id': 'req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.454631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] The token cache is being invalidate because project c3477448770245bd899e5aa590c3663b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:49.454919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.455528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.457257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1284/2538] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:49 2022] DELETE /identity/v3/projects/c3477448770245bd899e5aa590c3663b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:49.461165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:49.471429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ad992-024e-468a-bc69-346f1fe0b807 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:49.489863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:49.528931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:49.529800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:49.530088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:49.530368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] PATH_INFO: `/v3/users/4e5afc5ed0b040e2aa0b884eee407065` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:49.531552 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5afc5ed0b040e2aa0b884eee407065)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:49.534050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:49.579360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5afc5ed0b040e2aa0b884eee407065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.591667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5afc5ed0b040e2aa0b884eee407065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.599980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5afc5ed0b040e2aa0b884eee407065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.600583 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5afc5ed0b040e2aa0b884eee407065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.601281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-83944950-4db4-4e06-9c00-086217c1a64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5afc5ed0b040e2aa0b884eee407065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:49.614464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1255/2539] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:49 2022] DELETE /identity/v3/users/4e5afc5ed0b040e2aa0b884eee407065 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:49.894855 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:49.896384 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:49.913709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba74b-d4d9-4fb3-8408-f3474bf1dc8d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:49.973671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:49.974528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:49.974810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:49.975085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] PATH_INFO: `/v3/projects/a0f15981b33e4bc29dfff832a9905cde` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:49.976293 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f15981b33e4bc29dfff832a9905cde)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:49.978226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.008054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:50.025746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f15981b33e4bc29dfff832a9905cde', 'request_id': 'req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:50.031638 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f15981b33e4bc29dfff832a9905cde', 'request_id': 'req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:50.038121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f15981b33e4bc29dfff832a9905cde', 'request_id': 'req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:50.049535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] The token cache is being invalidate because project a0f15981b33e4bc29dfff832a9905cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:50.049887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:50.050495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1dd65b25-103b-4c6d-9f60-ae8e609c6e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:50.052061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1285/2540] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:49 2022] DELETE /identity/v3/projects/a0f15981b33e4bc29dfff832a9905cde => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:50.056916 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.057379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.057499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.075672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:50.076905 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:50.137279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1256/2541] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:50.145434 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.145728 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.146007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.164269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:50.165463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:50.174244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1286/2542] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:49:50.178352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.188153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe83bb-b271-4045-b3ca-4623e8aebe76 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.193144 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.193788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.194073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.194349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.195073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:50.195382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.197016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.209217 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1257/2543] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:50.213475 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.223236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e26f4-43ee-4d0d-82a4-e3a1722667cd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.228045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.228701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.228987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.229278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.229958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.231966 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.258705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1287/2544] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:50.262246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.273137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2dd2f-f336-44c4-af2c-b9ecc46deac7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.298862 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:50.331578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.332256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.332546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.332826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.333521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.335452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.355163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1258/2545] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:50.359414 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.369707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af828879-680b-479a-98a4-b888949f3b5d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.376737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.377740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.378042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.378317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.379320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.380980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.393186 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1288/2546] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:50.397112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.407095 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44c37-2586-43bc-9537-5765055f25b1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.411815 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c983e-0bbd-4a0d-8aed-25ab739c4d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.412488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c983e-0bbd-4a0d-8aed-25ab739c4d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.412775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c983e-0bbd-4a0d-8aed-25ab739c4d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.413055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c983e-0bbd-4a0d-8aed-25ab739c4d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.413806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c983e-0bbd-4a0d-8aed-25ab739c4d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.415395 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c983e-0bbd-4a0d-8aed-25ab739c4d61 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.425540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1259/2547] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:50.429997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.440730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40358-172a-440f-9759-48ab17e94658 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.445365 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.446293 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.446579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.446854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] PATH_INFO: `/v3/projects/7e220fb48f2b4bc3805a09937a1f3454/users/021cffe6be2342f9996686e44eedc174/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.462334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e220fb48f2b4bc3805a09937a1f3454, user_id=021cffe6be2342f9996686e44eedc174, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.465134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.479760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1289/2548] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:50 2022] PUT /identity/v3/projects/7e220fb48f2b4bc3805a09937a1f3454/users/021cffe6be2342f9996686e44eedc174/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:50.490936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.491231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.491512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.521221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] MFA Rules not processed for user `021cffe6be2342f9996686e44eedc174`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:50.522507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:50.590262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1260/2549] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:50.597216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.658367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dc69-c2e7-4933-96df-67892eb615b3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.663613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.664309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.664594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.664996 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.665901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.668497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.696821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1290/2550] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:50.700954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.712116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe032f7-5a64-4419-945d-91789bde3257 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.773890 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.774701 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.774825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.775086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.775771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.777724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.798887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1261/2551] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:50 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:50.803100 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.813926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4d5b8-4e2a-440e-9af4-fa7adf37e06e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.818850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.819539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.819823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.820136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.820859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.822464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.833995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1291/2552] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:50.838037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.848598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2420-7340-4181-a3b5-3dfd210e3056 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.855663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.856697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.856987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.857263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] PATH_INFO: `/v3/projects/bb8cc0d48b494b7ba8f1622570f31e14/users/db361dbc469044adbecb25dd0580a1b6/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.872335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8cc0d48b494b7ba8f1622570f31e14, user_id=db361dbc469044adbecb25dd0580a1b6, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.875007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.888592 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1262/2553] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:50 2022] PUT /identity/v3/projects/bb8cc0d48b494b7ba8f1622570f31e14/users/db361dbc469044adbecb25dd0580a1b6/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:50.893291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.903247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850e5e-778e-469b-acbb-64752a497951 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.924242 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:50.962718 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd5cf8-76b4-469e-bce2-d84381f5b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.963458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5cf8-76b4-469e-bce2-d84381f5b378 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.963752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5cf8-76b4-469e-bce2-d84381f5b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.964044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5cf8-76b4-469e-bce2-d84381f5b378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:50.964777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd5cf8-76b4-469e-bce2-d84381f5b378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:50.966455 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd5cf8-76b4-469e-bce2-d84381f5b378 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:50.976950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1292/2554] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:50.981168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:50.986655 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:50.993230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b75a-9741-4814-afa4-1d7e67fec938 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:50.998190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:50.999067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:50.999354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:50.999661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] PATH_INFO: `/v3/projects/bb8cc0d48b494b7ba8f1622570f31e14/users/db361dbc469044adbecb25dd0580a1b6/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.002351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8cc0d48b494b7ba8f1622570f31e14, user_id=db361dbc469044adbecb25dd0580a1b6, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:51.005371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:51.015509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1263/2555] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:50 2022] PUT /identity/v3/projects/bb8cc0d48b494b7ba8f1622570f31e14/users/db361dbc469044adbecb25dd0580a1b6/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:51.027991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:51.028316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:51.028597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.055060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] MFA Rules not processed for user `db361dbc469044adbecb25dd0580a1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:51.056308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:51.123154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1293/2556] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:51.135339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:51.137193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:51.192912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7160985-b0fe-4805-be58-8bc79d088caa admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:51.196481 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9f335-10ec-4292-8af4-b05376ef5060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:51.197120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f335-10ec-4292-8af4-b05376ef5060 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:51.197407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f335-10ec-4292-8af4-b05376ef5060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:51.197690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f335-10ec-4292-8af4-b05376ef5060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.207090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9f335-10ec-4292-8af4-b05376ef5060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:51.208554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9f335-10ec-4292-8af4-b05376ef5060 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:51.217940 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1264/2557] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:51.251078 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:51.313776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3f43f-b8d0-47cb-b059-c9135e3015ab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:51.318368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:51.319231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:51.319514 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:51.319786 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] PATH_INFO: `/v3/users/021cffe6be2342f9996686e44eedc174` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.321009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=021cffe6be2342f9996686e44eedc174)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:51.322951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:51.369235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021cffe6be2342f9996686e44eedc174'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.370329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:51.383233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021cffe6be2342f9996686e44eedc174'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.390113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021cffe6be2342f9996686e44eedc174'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.390730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021cffe6be2342f9996686e44eedc174'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.398165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021cffe6be2342f9996686e44eedc174'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.404058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1294/2558] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:51 2022] DELETE /identity/v3/users/021cffe6be2342f9996686e44eedc174 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:51.408860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:51.409151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:51.409429 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.428221 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:51.429421 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:51.486517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1265/2559] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:51.495991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:51.497410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:51.554385 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517d6a-873a-47d6-af5c-46e52890ec39 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:51.558131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:51.558778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:51.559066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:51.559346 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.569140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:51.570587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:51.580263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1295/2560] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:51.867418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:51.868907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:51.883344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e8b9b-f275-49c2-9756-e50fe12b280b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:51.889384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:51.890383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:51.890672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:51.890954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] PATH_INFO: `/v3/projects/7e220fb48f2b4bc3805a09937a1f3454` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:51.892616 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e220fb48f2b4bc3805a09937a1f3454)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:51.894538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:51.944373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e220fb48f2b4bc3805a09937a1f3454', 'request_id': 'req-163fa648-38aa-4a84-8b00-48a421417deb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.950337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e220fb48f2b4bc3805a09937a1f3454', 'request_id': 'req-163fa648-38aa-4a84-8b00-48a421417deb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.955922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e220fb48f2b4bc3805a09937a1f3454', 'request_id': 'req-163fa648-38aa-4a84-8b00-48a421417deb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.967968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] The token cache is being invalidate because project 7e220fb48f2b4bc3805a09937a1f3454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:51.968259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.968877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:51.971059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1266/2561] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:51 2022] DELETE /identity/v3/projects/7e220fb48f2b4bc3805a09937a1f3454 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:51.975152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:51.984765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215653-c9f0-428b-88dd-117fdfdb6173 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:52.040059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:52.040946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.041222 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.041504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] PATH_INFO: `/v3/users/db361dbc469044adbecb25dd0580a1b6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.042701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db361dbc469044adbecb25dd0580a1b6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:52.044725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:52.089459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db361dbc469044adbecb25dd0580a1b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.100997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db361dbc469044adbecb25dd0580a1b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.104493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:52.108411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db361dbc469044adbecb25dd0580a1b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.109329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db361dbc469044adbecb25dd0580a1b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.118515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2dbf098a-f3ac-463c-9f47-63e803875d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db361dbc469044adbecb25dd0580a1b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.124407 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1296/2562] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:51 2022] DELETE /identity/v3/users/db361dbc469044adbecb25dd0580a1b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:52.410775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:52.412340 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:52.431271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa648-38aa-4a84-8b00-48a421417deb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:52.448620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:52.508981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:52.509978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.510272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.510556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] PATH_INFO: `/v3/projects/bb8cc0d48b494b7ba8f1622570f31e14` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.511822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8cc0d48b494b7ba8f1622570f31e14)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:52.513917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:52.569892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8cc0d48b494b7ba8f1622570f31e14', 'request_id': 'req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.576515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8cc0d48b494b7ba8f1622570f31e14', 'request_id': 'req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.583294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8cc0d48b494b7ba8f1622570f31e14', 'request_id': 'req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.598101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] The token cache is being invalidate because project bb8cc0d48b494b7ba8f1622570f31e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:52.598396 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.599057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9e5edf6c-497b-4e7d-ab66-8cdb1564e130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:52.600752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1267/2563] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:52 2022] DELETE /identity/v3/projects/bb8cc0d48b494b7ba8f1622570f31e14 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:52.605915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.606215 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.606503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.633659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:52.637015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:52.711646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1297/2564] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:52.722063 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.722362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.722645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.746841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:52.749349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:52.760779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1268/2565] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:52.765631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:52.778334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4383c-cca1-4ab1-a39b-df5f1d7116f4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:52.783704 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:52.784405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.784750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.785094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.785838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:52.786199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:52.787858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:52.804087 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1298/2566] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:52.808752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:52.819347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b732a-53c1-489c-a8c9-30e9902786fc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:52.826784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:52.827376 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.827659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.827970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.829121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:52.830869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:52.864078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1269/2567] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:52 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:52.864540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:52.878823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e731ca-5dae-4890-8da9-dc33c9703c02 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:52.944787 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:52.945465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.945832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.946108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.946869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:52.949007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:52.971495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1299/2568] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:52 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:52.975648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:52.986611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2700f-7989-4f3c-b22a-9b45e7594185 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:52.991464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:52.992168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:52.992505 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:52.992789 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:52.993572 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:52.995178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:53.006825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1270/2569] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:53.012008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:53.023747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dbf3c-2792-4d30-b4e5-bade4eee9e58 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:53.029944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f80f32-6f19-430d-be7b-b5aec20478f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:53.030899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f80f32-6f19-430d-be7b-b5aec20478f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:53.031287 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f80f32-6f19-430d-be7b-b5aec20478f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:53.032430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f80f32-6f19-430d-be7b-b5aec20478f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:53.033347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f80f32-6f19-430d-be7b-b5aec20478f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:53.035109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f80f32-6f19-430d-be7b-b5aec20478f9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:53.045840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1300/2570] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:53.052110 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:53.063686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f6e2c-6d4f-4ea2-8fb9-d4d86efd557b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:53.068454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:53.069351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:53.069636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:53.069912 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] PATH_INFO: `/v3/projects/44e2d8dfc69045bcb4cb99406e9c0c45/users/44c24c007eac4f939c0db242104ba6ae/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:53.085952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e2d8dfc69045bcb4cb99406e9c0c45, user_id=44c24c007eac4f939c0db242104ba6ae, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:53.088643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:53.102532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1271/2571] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:53 2022] PUT /identity/v3/projects/44e2d8dfc69045bcb4cb99406e9c0c45/users/44c24c007eac4f939c0db242104ba6ae/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:53.108391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cdd0-2264-4179-a3ae-44d00a25c6cf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:53.108694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cdd0-2264-4179-a3ae-44d00a25c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:53.108983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cdd0-2264-4179-a3ae-44d00a25c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:53.128861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-35e6cdd0-2264-4179-a3ae-44d00a25c6cf None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:53.130673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-35e6cdd0-2264-4179-a3ae-44d00a25c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:53.179534 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:53.192630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1301/2572] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:53.202439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:53.204959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:53.250028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:53.263969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194454-0cde-43b2-9ef0-4561fd948e72 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:53.268215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:53.268873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:53.269146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:53.269420 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:53.278465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:53.279939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:53.289489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1272/2573] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:53.913212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:53.913601 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:53.914313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:53.948578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] MFA Rules not processed for user `44c24c007eac4f939c0db242104ba6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:53.949902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:54.038451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1302/2574] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:54.042968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:54.053584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cebb6-6496-4784-83d9-69ece7b33fc2 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:54.058146 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:54.058799 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:54.059086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:54.059365 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:54.060106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:54.062029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:54.088036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1273/2575] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:54 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:54.092130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:54.104257 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4122d-5756-4139-8957-3b87efb18a81 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:54.175487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:54.176552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:54.176982 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:54.177387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:54.178182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:54.180564 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:54.199652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1303/2576] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:54 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:49:54.204260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:54.215663 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071548-c4f3-4ab9-bdbd-3b4eb42a4dfb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:54.222366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:54.223067 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:54.223411 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:54.224132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:54.224471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:54.226138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:54.243319 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1274/2577] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:54.247726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:54.258307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a1e0-ee01-46c1-9d91-a1e4d111f499 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:54.263041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:54.264015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:54.264308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:54.264619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] PATH_INFO: `/v3/projects/dc93defd84f242c7a37b7a0bbe68b313/users/06c243d0ff6e422083548bc944f8c751/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:54.279157 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc93defd84f242c7a37b7a0bbe68b313, user_id=06c243d0ff6e422083548bc944f8c751, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:54.282496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:54.296220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1304/2578] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:54 2022] PUT /identity/v3/projects/dc93defd84f242c7a37b7a0bbe68b313/users/06c243d0ff6e422083548bc944f8c751/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:54.300976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:54.310931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da83bd-ea26-4fca-bc43-f11c682233c6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:54.366571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171f7f2-a1e1-40eb-8176-5a4f2f19886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:54.367239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171f7f2-a1e1-40eb-8176-5a4f2f19886a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:54.367524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171f7f2-a1e1-40eb-8176-5a4f2f19886a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:54.367798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171f7f2-a1e1-40eb-8176-5a4f2f19886a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:54.368576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171f7f2-a1e1-40eb-8176-5a4f2f19886a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:54.370163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171f7f2-a1e1-40eb-8176-5a4f2f19886a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:54.380807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1275/2579] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:54.384850 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:54.395896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e916-bd6b-4a9d-9e45-df5d407d14df admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:54.400458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:54.401327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:54.401606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:54.401877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] PATH_INFO: `/v3/projects/dc93defd84f242c7a37b7a0bbe68b313/users/06c243d0ff6e422083548bc944f8c751/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:54.403824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc93defd84f242c7a37b7a0bbe68b313, user_id=06c243d0ff6e422083548bc944f8c751, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:54.406533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:54.417597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1305/2580] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:54 2022] PUT /identity/v3/projects/dc93defd84f242c7a37b7a0bbe68b313/users/06c243d0ff6e422083548bc944f8c751/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:49:55.040924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:55.041299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:55.041656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:55.090716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] MFA Rules not processed for user `06c243d0ff6e422083548bc944f8c751`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:55.092116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:55.186762 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1276/2581] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:55.195294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:55.197057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:55.244480 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:55.269203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90cef-063f-44c7-817f-965378b41601 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:55.272986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:55.273659 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:55.273952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:55.274259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:55.340747 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:55.342216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:55.351743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1306/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:56.712394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:56.722041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6ec0-52d2-429c-a185-d6651ec62d63 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:56.725517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:56.726173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:56.726458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:56.726733 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:56.736687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:56.738148 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:56.747665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1277/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:49:58.264496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:58.273460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:58.348248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c1686-66f1-448c-b036-a05beaf56c90 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:58.352745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:58.353614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:58.353900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:58.354179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] PATH_INFO: `/v3/users/5b995c6bf02b4e50aa836324c6f3414e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:58.355362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b995c6bf02b4e50aa836324c6f3414e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:58.357351 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:58.405260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b995c6bf02b4e50aa836324c6f3414e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.418354 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b995c6bf02b4e50aa836324c6f3414e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.426066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b995c6bf02b4e50aa836324c6f3414e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.426720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b995c6bf02b4e50aa836324c6f3414e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.434316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-234e9576-99a8-4193-9da7-dafd400a92dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b995c6bf02b4e50aa836324c6f3414e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.440160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1307/2584] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:49:58 2022] DELETE /identity/v3/users/5b995c6bf02b4e50aa836324c6f3414e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:58.608466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:58.621478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c05e6-149e-465e-b1a7-d1b83aa50d3b service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:58.640735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:58.685944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:58.686807 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:58.687094 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:58.687374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] PATH_INFO: `/v3/projects/500e8157246e450ea87f751218856c7a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:58.689231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500e8157246e450ea87f751218856c7a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:58.691219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:58.738351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500e8157246e450ea87f751218856c7a', 'request_id': 'req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.744275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500e8157246e450ea87f751218856c7a', 'request_id': 'req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.750986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500e8157246e450ea87f751218856c7a', 'request_id': 'req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.763582 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] The token cache is being invalidate because project 500e8157246e450ea87f751218856c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:49:58.763929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.764556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a7fb3acb-8d3b-48e1-8f7b-31ada683c145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:49:58.767171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1278/2585] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:49:58 2022] DELETE /identity/v3/projects/500e8157246e450ea87f751218856c7a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:58.771863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:58.772419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:58.772731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:58.790900 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:58.792058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:58.796210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:58.852489 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1308/2586] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:49:58.860491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:58.860828 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:58.861281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:58.880059 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:58.881257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:58.889514 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1279/2587] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:58.893582 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:58.904147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b903-9335-452e-a95a-597a1d912e08 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:58.908832 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:58.909491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:58.909779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:58.910062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:58.910793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:49:58.911402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:58.913088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:58.926705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1309/2588] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:49:58.931064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:58.941307 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608223-5a99-4827-a61a-c0c33c0a544e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:58.945967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:58.946611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:58.946899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:58.947204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:58.947953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:58.949881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:58.975171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1280/2589] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:49:58 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:58.978817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:58.989212 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecaab-073d-4210-be27-3930eb712948 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:59.044375 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:59.044964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:59.045248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:59.045525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:59.046200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:59.048283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:59.067779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1310/2590] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:49:58 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:49:59.071793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:59.082661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee3462-b5e5-4563-8f6d-dc95b5d5d0c1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:59.087296 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:59.087979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:59.088267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:59.088547 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:59.089293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:59.090869 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:59.101728 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1281/2591] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:59.105535 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:59.115592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d920d2-4aa0-4df5-90cb-f4bf2f22cf32 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:59.120203 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb10c3-cdbc-42da-9fad-dedd06bb97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:59.120842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb10c3-cdbc-42da-9fad-dedd06bb97bb admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:59.121126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb10c3-cdbc-42da-9fad-dedd06bb97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:59.121401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb10c3-cdbc-42da-9fad-dedd06bb97bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:59.122116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb10c3-cdbc-42da-9fad-dedd06bb97bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:59.123708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb10c3-cdbc-42da-9fad-dedd06bb97bb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:59.134431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1311/2592] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:49:59.138611 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:59.149558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432fb78-13fa-434a-9233-e6c630cf1dac admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:59.154306 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:59.155191 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:59.155508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:59.155791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] PATH_INFO: `/v3/projects/75c26642fcde442a887d4cdb487eb402/users/5a227dcebc4c4c3cb0aa5f3beac94248/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:59.171806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c26642fcde442a887d4cdb487eb402, user_id=5a227dcebc4c4c3cb0aa5f3beac94248, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:59.174742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:59.187349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1282/2593] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:49:59 2022] PUT /identity/v3/projects/75c26642fcde442a887d4cdb487eb402/users/5a227dcebc4c4c3cb0aa5f3beac94248/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:49:59.197177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:59.197456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:59.197732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:59.224433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] MFA Rules not processed for user `5a227dcebc4c4c3cb0aa5f3beac94248`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:49:59.225635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:59.289154 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1312/2594] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:49:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:49:59.301873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:49:59.303579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:49:59.357667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:59.365446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb00d38-54df-4e24-bf0e-e50a1d00a61d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:49:59.370556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319dcb6-3031-46e5-9532-428781e6967c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:49:59.371214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319dcb6-3031-46e5-9532-428781e6967c service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:49:59.371499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319dcb6-3031-46e5-9532-428781e6967c service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:49:59.371780 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319dcb6-3031-46e5-9532-428781e6967c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:49:59.381447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319dcb6-3031-46e5-9532-428781e6967c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:49:59.382958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319dcb6-3031-46e5-9532-428781e6967c service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:49:59.392758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1283/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:49:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:09.286083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:09.387977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:09.517595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:09.579460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0e47-fe88-4b52-acf2-eafd6ac06fd9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:09.583933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:09.584829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:09.585113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:09.585387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] PATH_INFO: `/v3/users/5a227dcebc4c4c3cb0aa5f3beac94248` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:09.586570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a227dcebc4c4c3cb0aa5f3beac94248)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:09.588613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:09.634799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a227dcebc4c4c3cb0aa5f3beac94248'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:09.647431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a227dcebc4c4c3cb0aa5f3beac94248'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:09.654493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a227dcebc4c4c3cb0aa5f3beac94248'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:09.655171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a227dcebc4c4c3cb0aa5f3beac94248'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:09.662137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a227dcebc4c4c3cb0aa5f3beac94248'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:09.667889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1313/2596] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:09 2022] DELETE /identity/v3/users/5a227dcebc4c4c3cb0aa5f3beac94248 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:09.672938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9b994-b4c7-408c-a474-312db217264f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:09.673226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9b994-b4c7-408c-a474-312db217264f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:09.673506 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9b994-b4c7-408c-a474-312db217264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:09.690453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-11c9b994-b4c7-408c-a474-312db217264f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:09.691649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-11c9b994-b4c7-408c-a474-312db217264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:09.756521 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1284/2597] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:09.766799 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:09.769313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:09.830440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd39bed-ac53-421f-8046-4c1398a002c1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:09.834236 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5255c1f-9702-45ff-b4af-a6f4dc51bc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:09.834913 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5255c1f-9702-45ff-b4af-a6f4dc51bc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:09.835189 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5255c1f-9702-45ff-b4af-a6f4dc51bc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:09.835472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5255c1f-9702-45ff-b4af-a6f4dc51bc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:09.845378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5255c1f-9702-45ff-b4af-a6f4dc51bc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:09.846829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5255c1f-9702-45ff-b4af-a6f4dc51bc6c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:09.856528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1314/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:10.186445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9b994-b4c7-408c-a474-312db217264f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.188915 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-11c9b994-b4c7-408c-a474-312db217264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:10.235608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9b994-b4c7-408c-a474-312db217264f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.242262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.243676 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.244100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.244498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] PATH_INFO: `/v3/projects/75c26642fcde442a887d4cdb487eb402` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.246212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c26642fcde442a887d4cdb487eb402)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.248705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.310384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c26642fcde442a887d4cdb487eb402', 'request_id': 'req-2b1b2f20-9fe2-4bd5-af2e-71af82742493'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:10.317952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c26642fcde442a887d4cdb487eb402', 'request_id': 'req-2b1b2f20-9fe2-4bd5-af2e-71af82742493'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:10.323650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c26642fcde442a887d4cdb487eb402', 'request_id': 'req-2b1b2f20-9fe2-4bd5-af2e-71af82742493'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:10.336856 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] The token cache is being invalidate because project 75c26642fcde442a887d4cdb487eb402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:10.337084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:10.337709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b1b2f20-9fe2-4bd5-af2e-71af82742493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:10.339439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1285/2599] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:10 2022] DELETE /identity/v3/projects/75c26642fcde442a887d4cdb487eb402 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:10.345240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.345778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.345910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.365445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:10.366675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:10.384810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:10.430155 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1315/2600] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:10.439278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.439782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.439918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.458665 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:10.459892 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:10.467809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1286/2601] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:10.472905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.482563 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6f0d-dfa4-4229-aac4-15765c4370e3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.487194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.487872 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.488165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.488438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.489175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:50:10.489474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.491094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.504405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1316/2602] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:50:10.508599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.518169 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633d640-4cbc-4911-9e06-7cf653e22585 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.522851 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.523502 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.523788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.524092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.524782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.526756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.553549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1287/2603] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:10.557571 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.568303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc161b1-500d-452d-8e7a-23f73dcf144e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.645684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.646721 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.647076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.647491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.648458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.650757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.690355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1317/2604] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:50:10 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:50:10.695763 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.719886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa06fb-9d45-4e9f-a92c-a10e712a9491 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.725131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.726168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.726457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.726735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.727476 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.729210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.749009 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1288/2605] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:10.749383 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.762511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19887b8-15e7-4634-a359-a706a039384e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.769536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c51ca5-1c24-4eab-ba6e-97712066a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.770491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c51ca5-1c24-4eab-ba6e-97712066a6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.770780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c51ca5-1c24-4eab-ba6e-97712066a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.771058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c51ca5-1c24-4eab-ba6e-97712066a6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.772369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c51ca5-1c24-4eab-ba6e-97712066a6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.775460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c51ca5-1c24-4eab-ba6e-97712066a6e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.790012 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1318/2606] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:10.794224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:10.818744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdaacd-005e-4bc6-ab9c-467545079b4f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:10.827202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:10.828874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.829171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.829449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] PATH_INFO: `/v3/projects/5ccf6560673c40cb9f4acb20d10400c6/users/16029fcf926c49f9b8cf10f41db61436/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.854538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccf6560673c40cb9f4acb20d10400c6, user_id=16029fcf926c49f9b8cf10f41db61436, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:10.857365 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:10.899031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1289/2607] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:50:10 2022] PUT /identity/v3/projects/5ccf6560673c40cb9f4acb20d10400c6/users/16029fcf926c49f9b8cf10f41db61436/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:10.904432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:10.904793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:10.905130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:10.925624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:10.926962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:10.998206 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1319/2608] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:11.018196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:11.022124 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:11.047188 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:11.085944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ad1ee-e92f-431b-9e30-8dbdd2586816 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:11.089684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:11.090334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:11.090620 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:11.090939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:11.102657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:11.104993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:11.114102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1290/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:14.841285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:14.842711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:14.856357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f495-17af-47bf-acc6-dd7d9ffda20f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:14.868756 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:14.870268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:14.873877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:14.874173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] PATH_INFO: `/v3/users/44c24c007eac4f939c0db242104ba6ae` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:14.878091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c24c007eac4f939c0db242104ba6ae)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:14.882069 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:14.917254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:14.967042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c24c007eac4f939c0db242104ba6ae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:14.987775 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c24c007eac4f939c0db242104ba6ae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:14.998237 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c24c007eac4f939c0db242104ba6ae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:14.999099 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c24c007eac4f939c0db242104ba6ae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.009328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c24c007eac4f939c0db242104ba6ae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.022213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1320/2610] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:14 2022] DELETE /identity/v3/users/44c24c007eac4f939c0db242104ba6ae => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:15.273834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:15.290439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb37907-4717-4169-89f5-d939113bb11b service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:15.378087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:15.379326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:15.379962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:15.380477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] PATH_INFO: `/v3/projects/44e2d8dfc69045bcb4cb99406e9c0c45` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:15.382075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e2d8dfc69045bcb4cb99406e9c0c45)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:15.384594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:15.444261 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e2d8dfc69045bcb4cb99406e9c0c45', 'request_id': 'req-35051ea1-5426-43b5-802a-cfba656c52d1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.452123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e2d8dfc69045bcb4cb99406e9c0c45', 'request_id': 'req-35051ea1-5426-43b5-802a-cfba656c52d1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.461291 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e2d8dfc69045bcb4cb99406e9c0c45', 'request_id': 'req-35051ea1-5426-43b5-802a-cfba656c52d1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.479634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] The token cache is being invalidate because project 44e2d8dfc69045bcb4cb99406e9c0c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:15.480150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.481002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.483528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1291/2611] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:15 2022] DELETE /identity/v3/projects/44e2d8dfc69045bcb4cb99406e9c0c45 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:15.488245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:15.489794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:15.504851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cbae2-c6f7-4ad3-ba3d-cec271737f27 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:15.589348 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:15.591424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:15.592094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:15.592587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] PATH_INFO: `/v3/users/06c243d0ff6e422083548bc944f8c751` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:15.595113 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c243d0ff6e422083548bc944f8c751)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:15.598096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:15.670135 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c243d0ff6e422083548bc944f8c751'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.686376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c243d0ff6e422083548bc944f8c751'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.709730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c243d0ff6e422083548bc944f8c751'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.711054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c243d0ff6e422083548bc944f8c751'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.721645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-15c8194e-78dd-4825-a81c-0fbf8364fe9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c243d0ff6e422083548bc944f8c751'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:15.734322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1321/2612] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:15 2022] DELETE /identity/v3/users/06c243d0ff6e422083548bc944f8c751 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:15.952889 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:15.954782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:15.976039 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051ea1-5426-43b5-802a-cfba656c52d1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.042357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:16.060442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351591ec-1b49-4236-8369-048427855169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.061426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351591ec-1b49-4236-8369-048427855169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.061720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351591ec-1b49-4236-8369-048427855169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.062004 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351591ec-1b49-4236-8369-048427855169 admin admin] PATH_INFO: `/v3/projects/dc93defd84f242c7a37b7a0bbe68b313` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.064227 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351591ec-1b49-4236-8369-048427855169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc93defd84f242c7a37b7a0bbe68b313)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.066742 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351591ec-1b49-4236-8369-048427855169 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.134610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-351591ec-1b49-4236-8369-048427855169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc93defd84f242c7a37b7a0bbe68b313', 'request_id': 'req-351591ec-1b49-4236-8369-048427855169'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:16.142953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-351591ec-1b49-4236-8369-048427855169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc93defd84f242c7a37b7a0bbe68b313', 'request_id': 'req-351591ec-1b49-4236-8369-048427855169'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:16.150159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-351591ec-1b49-4236-8369-048427855169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc93defd84f242c7a37b7a0bbe68b313', 'request_id': 'req-351591ec-1b49-4236-8369-048427855169'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:16.164443 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-351591ec-1b49-4236-8369-048427855169 admin admin] The token cache is being invalidate because project dc93defd84f242c7a37b7a0bbe68b313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:16.164739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-351591ec-1b49-4236-8369-048427855169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:16.165370 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-351591ec-1b49-4236-8369-048427855169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:16.166929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1292/2613] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:15 2022] DELETE /identity/v3/projects/dc93defd84f242c7a37b7a0bbe68b313 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:16.172783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.173511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.173689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.196604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:16.197926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:16.215200 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:16.290171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1322/2614] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:16.299216 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.299694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.299794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.370612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:16.372453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:16.391902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1293/2615] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:16.396531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.419627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028a72-076a-40f6-a710-57f309cd3bf3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.433269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.435044 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.435513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.437246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.440063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:50:16.440662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.452095 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c2d1-105d-4f23-80ec-65efcc4926c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.473869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1323/2616] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:50:16.474066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.485330 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f4f45-fdc0-4b37-aeb4-09e5c19d97f1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.490600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.491215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.491648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.492347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.493315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.496013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.527174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.527766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.528178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.544513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1294/2617] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:16.547471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.587124 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] MFA Rules not processed for user `16029fcf926c49f9b8cf10f41db61436`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:16.588409 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:16.650498 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e818d-d022-4938-b182-68a69c408df0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.655627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.656867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.657525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.657823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.658532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.660727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.686125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1295/2618] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:16.690441 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.701195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204005-f98c-4e08-9d8f-16f2ac4307d3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.706857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.707540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.707824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.708138 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.708981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.709807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1324/2619] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:50:16.714030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.714212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.715962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:16.730378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1296/2620] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:50:16.731596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.735259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ab22-7fc2-4d20-9a7d-8db6c72dcea0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.742149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.742523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d675a1-baa2-4105-9077-0a4fe7687d89 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.742869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.743381 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.743790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.744637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.746822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.747827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.748534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.748965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.749249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.749993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.752491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.766159 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1297/2621] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:16.771731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.784656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f1179-39ac-437c-95ca-0460106b1d0b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.786144 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1325/2622] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:50:16.790890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.812518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:16.870961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff19ff1-4d7d-43b5-9a95-cb476011afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.872408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19ff1-4d7d-43b5-9a95-cb476011afdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.872707 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19ff1-4d7d-43b5-9a95-cb476011afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.872987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19ff1-4d7d-43b5-9a95-cb476011afdb admin admin] PATH_INFO: `/v3/projects/caf7c418d9f8428092b0275860a851da/users/37c791e8828e4b08a5a839f849c4707c/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.878436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ec8a-99f1-4597-b48d-f5c7a7e26a2a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.885987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:16.887459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.887944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.888679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.889668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.890304 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff19ff1-4d7d-43b5-9a95-cb476011afdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf7c418d9f8428092b0275860a851da, user_id=37c791e8828e4b08a5a839f849c4707c, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:16.893188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.893784 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff19ff1-4d7d-43b5-9a95-cb476011afdb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:16.913672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1298/2623] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:50:16 2022] PUT /identity/v3/projects/caf7c418d9f8428092b0275860a851da/users/37c791e8828e4b08a5a839f849c4707c/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:16.925991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:16.928791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1326/2624] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:16.930128 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:16.930424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:16.932621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:16.941420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:16.947223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c132-27f0-4bc2-946d-09863011184c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:16.973453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] MFA Rules not processed for user `37c791e8828e4b08a5a839f849c4707c`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:16.975007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:17.029774 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:17.031049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:17.033114 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:17.033742 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:17.034943 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:17.037332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:17.053793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1327/2625] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:50:17.058057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:17.069450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1299/2626] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:17.077942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734fcf9-a61e-4927-b62e-889a26ce4341 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:17.087618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:17.088643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:17.088845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:17.089121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] PATH_INFO: `/v3/projects/27a1d9c58aad460fbdbb1b8d359faf32/users/580707ec89d143bf9b0156fd6fa74df4/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:17.091052 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:17.093045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:17.108390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a1d9c58aad460fbdbb1b8d359faf32, user_id=580707ec89d143bf9b0156fd6fa74df4, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:17.111776 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:17.125317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1328/2627] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:50:17 2022] PUT /identity/v3/projects/27a1d9c58aad460fbdbb1b8d359faf32/users/580707ec89d143bf9b0156fd6fa74df4/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:50:17.129483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:17.159161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc8c17-3e4d-447b-84b1-5813d6267179 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:17.201623 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f319-c986-4377-80db-41f33b8d25dd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:17.211396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:17.212213 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:17.212587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:17.212963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:17.213841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:17.215654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:17.220423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:17.220785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:17.221073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:17.221354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:17.225860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:17.228096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1329/2628] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:50:17.232026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:17.242239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01cd4a-d97d-48da-b613-ca3a60a759e4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:17.247311 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b6ff8-e826-45c1-a767-d94677ae3f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:17.248555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b6ff8-e826-45c1-a767-d94677ae3f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:17.248831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b6ff8-e826-45c1-a767-d94677ae3f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:17.249106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b6ff8-e826-45c1-a767-d94677ae3f1c admin admin] PATH_INFO: `/v3/projects/27a1d9c58aad460fbdbb1b8d359faf32/users/580707ec89d143bf9b0156fd6fa74df4/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:17.252265 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b6ff8-e826-45c1-a767-d94677ae3f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a1d9c58aad460fbdbb1b8d359faf32, user_id=580707ec89d143bf9b0156fd6fa74df4, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:17.255241 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b6ff8-e826-45c1-a767-d94677ae3f1c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:17.265665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1330/2629] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:50:17 2022] PUT /identity/v3/projects/27a1d9c58aad460fbdbb1b8d359faf32/users/580707ec89d143bf9b0156fd6fa74df4/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:50:17.286114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:17.287575 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:17.298041 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1300/2630] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:23.818884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:23.819401 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:23.819504 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:23.852367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] MFA Rules not processed for user `580707ec89d143bf9b0156fd6fa74df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:23.853599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:23.910562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:23.951868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1331/2631] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:23.969803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:23.969803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:24.052347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeee3f-f4f4-49a1-9332-b7f1d0103b1f service glance] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:24.124354 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a325-ae34-4c9b-8de2-4e687821bdca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:24.125594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a325-ae34-4c9b-8de2-4e687821bdca service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:24.125876 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a325-ae34-4c9b-8de2-4e687821bdca service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:24.126150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a325-ae34-4c9b-8de2-4e687821bdca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:24.177970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:24.196234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a325-ae34-4c9b-8de2-4e687821bdca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:24.197907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a325-ae34-4c9b-8de2-4e687821bdca service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:24.209710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1301/2632] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:24.797743 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:24.799361 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:24.875433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c149-7d33-444e-b47a-5597327860c4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:24.879918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:24.880909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:24.881202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:24.881483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:24.883350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:24.971263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:24.975034 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:24.988150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1332/2633] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:25.808320 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:25.808814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:25.808935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:25.830322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] MFA Rules not processed for user `16029fcf926c49f9b8cf10f41db61436`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:25.831593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:25.838516 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1302/2634] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:32.060748 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:32.062796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:32.077074 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58206d8b-77ad-49c0-a997-987a640cc49d service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:32.083663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:32.084625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:32.084917 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:32.085202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] PATH_INFO: `/v3/users/00cfbc965d934d6db28f41f8082eb5ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:32.103174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cfbc965d934d6db28f41f8082eb5ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:32.105374 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:32.153270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cfbc965d934d6db28f41f8082eb5ef'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.166093 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cfbc965d934d6db28f41f8082eb5ef'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.173962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cfbc965d934d6db28f41f8082eb5ef'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.174735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cfbc965d934d6db28f41f8082eb5ef'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.184179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:32.186733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cfbc965d934d6db28f41f8082eb5ef'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.195062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1333/2635] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:32 2022] DELETE /identity/v3/users/00cfbc965d934d6db28f41f8082eb5ef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:32.381782 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:32.394467 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ef26-7f51-42f0-9c7b-6ed8c317dd9b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:32.454235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:32.455103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:32.455391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:32.455675 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] PATH_INFO: `/v3/projects/49c7f224d0374125ae22f576e8757f29` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:32.467163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c7f224d0374125ae22f576e8757f29)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:32.469226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:32.517151 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c7f224d0374125ae22f576e8757f29', 'request_id': 'req-919f4872-4231-4240-a2b0-9af7ddf6f98f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.526688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c7f224d0374125ae22f576e8757f29', 'request_id': 'req-919f4872-4231-4240-a2b0-9af7ddf6f98f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.535541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c7f224d0374125ae22f576e8757f29', 'request_id': 'req-919f4872-4231-4240-a2b0-9af7ddf6f98f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.549472 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] The token cache is being invalidate because project 49c7f224d0374125ae22f576e8757f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:32.549770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.550415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.552008 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1303/2636] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:32 2022] DELETE /identity/v3/projects/49c7f224d0374125ae22f576e8757f29 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:32.556188 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:32.557644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:32.571784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972e23-c1f9-440f-bfc9-88323374f565 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:32.632741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:32.633664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:32.633980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:32.634259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] PATH_INFO: `/v3/users/e7853811842340f092c47ec883052d01` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:32.649974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7853811842340f092c47ec883052d01)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:32.652258 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:32.701423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7853811842340f092c47ec883052d01'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.713456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7853811842340f092c47ec883052d01'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.721347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7853811842340f092c47ec883052d01'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.721980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7853811842340f092c47ec883052d01'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.729528 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7853811842340f092c47ec883052d01'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:32.736233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1334/2637] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:32 2022] DELETE /identity/v3/users/e7853811842340f092c47ec883052d01 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:32.920099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:32.921576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:32.939642 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4872-4231-4240-a2b0-9af7ddf6f98f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:32.992756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:33.006156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:33.007236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:33.007825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:33.008309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] PATH_INFO: `/v3/projects/86fcb8e7e5864731966b217aa690ee62` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:33.024213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fcb8e7e5864731966b217aa690ee62)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:33.024213 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:33.075966 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fcb8e7e5864731966b217aa690ee62', 'request_id': 'req-518985ee-799c-46e5-8935-6174ffef33ec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:33.084538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fcb8e7e5864731966b217aa690ee62', 'request_id': 'req-518985ee-799c-46e5-8935-6174ffef33ec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:33.090195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fcb8e7e5864731966b217aa690ee62', 'request_id': 'req-518985ee-799c-46e5-8935-6174ffef33ec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:33.105255 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] The token cache is being invalidate because project 86fcb8e7e5864731966b217aa690ee62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:33.105632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:33.106337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-518985ee-799c-46e5-8935-6174ffef33ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:33.107989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1304/2638] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:32 2022] DELETE /identity/v3/projects/86fcb8e7e5864731966b217aa690ee62 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:41.632680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:41.634091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:41.679548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d19ed0-73aa-4dc2-9fa4-2881f31f17cb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:41.707320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:41.736463 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:41.737800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:41.738088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:41.738368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] PATH_INFO: `/v3/users/37c791e8828e4b08a5a839f849c4707c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:41.739611 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c791e8828e4b08a5a839f849c4707c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:41.741615 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:41.790006 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c791e8828e4b08a5a839f849c4707c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:41.802674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c791e8828e4b08a5a839f849c4707c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:41.809396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c791e8828e4b08a5a839f849c4707c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:41.809986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c791e8828e4b08a5a839f849c4707c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:41.819020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c791e8828e4b08a5a839f849c4707c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:41.825726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1335/2639] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:41 2022] DELETE /identity/v3/users/37c791e8828e4b08a5a839f849c4707c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:41.830927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:41.831459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:41.831459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:41.849810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:41.851019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:41.911136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1305/2640] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:41.920923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:41.922339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:41.999096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf756a-c574-4842-a501-9a47f9f4af82 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.002801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f107e9-66d9-42de-9a25-b17e4d8aa304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.003449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f107e9-66d9-42de-9a25-b17e4d8aa304 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.003736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f107e9-66d9-42de-9a25-b17e4d8aa304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.004039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f107e9-66d9-42de-9a25-b17e4d8aa304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.013875 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f107e9-66d9-42de-9a25-b17e4d8aa304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.015343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f107e9-66d9-42de-9a25-b17e4d8aa304 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.025890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1336/2641] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:42.307688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.309157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:42.327437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f1ce-ccb0-4a67-9814-95d305c162c7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.333355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.334233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.334588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.334914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] PATH_INFO: `/v3/projects/caf7c418d9f8428092b0275860a851da` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.336050 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf7c418d9f8428092b0275860a851da)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.337987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.386142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf7c418d9f8428092b0275860a851da', 'request_id': 'req-dc989b58-6675-4d2f-b8d5-ac234900cc4d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:42.392178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf7c418d9f8428092b0275860a851da', 'request_id': 'req-dc989b58-6675-4d2f-b8d5-ac234900cc4d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:42.398209 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf7c418d9f8428092b0275860a851da', 'request_id': 'req-dc989b58-6675-4d2f-b8d5-ac234900cc4d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:42.407005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:42.411817 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] The token cache is being invalidate because project caf7c418d9f8428092b0275860a851da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:42.412474 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:42.413233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc989b58-6675-4d2f-b8d5-ac234900cc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:42.414924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1306/2642] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:42 2022] DELETE /identity/v3/projects/caf7c418d9f8428092b0275860a851da => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:42.419926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.420224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.420509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.438175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:42.439377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:42.474866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:42.507793 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1337/2643] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:42.516341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.516640 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.516933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.536315 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:42.537530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:42.545480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1307/2644] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:42.549764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.559431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62df3-2413-4e03-ba1c-72e127b2b64d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.563986 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.564680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.564965 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.565248 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.565974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:50:42.566290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.567920 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.579305 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1338/2645] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:50:42.584391 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.593810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fce4b-3008-4ae4-b458-d31c120f4c66 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.600054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.600713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.600998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.601275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.602001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.603944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.629398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1308/2646] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:50:42 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:42.633778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.644568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805754-ae91-4719-93ec-5e04648acc43 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.699627 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.700328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.700616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.700896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.701585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.703526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.723643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1339/2647] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:50:42 2022] POST /identity/v3/users => generated 281 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:42.727754 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.738562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c818ac-5420-4863-bfbb-2a6f57ee12b9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.743199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.743878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.744171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.744453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.745183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.746794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.758103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1309/2648] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:42.761944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.772892 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0be7-98e3-44f7-87b4-3801898a6e55 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.777575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca1710-56e6-4dcf-a823-0bf19bd11d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.778238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1710-56e6-4dcf-a823-0bf19bd11d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.778525 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1710-56e6-4dcf-a823-0bf19bd11d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.778830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1710-56e6-4dcf-a823-0bf19bd11d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.779559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1710-56e6-4dcf-a823-0bf19bd11d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.781201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1710-56e6-4dcf-a823-0bf19bd11d5c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.791707 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1340/2649] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:42.796183 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.806811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97be3f-c74b-46fa-9583-edd39e0634b8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:42.811403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:42.812311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.812595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.812864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] PATH_INFO: `/v3/projects/7d53253b96f24bc4a90a2e242858a7d3/users/b18fe42493064b8a96576cfddd7622a0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.828924 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d53253b96f24bc4a90a2e242858a7d3, user_id=b18fe42493064b8a96576cfddd7622a0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:42.832266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:42.845199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1310/2650] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:50:42 2022] PUT /identity/v3/projects/7d53253b96f24bc4a90a2e242858a7d3/users/b18fe42493064b8a96576cfddd7622a0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:42.856129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:42.856427 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:42.856712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:42.883106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] MFA Rules not processed for user `b18fe42493064b8a96576cfddd7622a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:42.884347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:42.946625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1341/2651] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:42.976957 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:42.978636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:43.035551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d44933-8b1d-4cd5-8b0d-d29f56ac7cdb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:43.039056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996b1c6-d3d3-4564-823a-7b1501cfd2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:43.039688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996b1c6-d3d3-4564-823a-7b1501cfd2db service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.040012 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996b1c6-d3d3-4564-823a-7b1501cfd2db service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.040546 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996b1c6-d3d3-4564-823a-7b1501cfd2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.048654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996b1c6-d3d3-4564-823a-7b1501cfd2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:43.050666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996b1c6-d3d3-4564-823a-7b1501cfd2db service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:43.059308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1311/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:43.073490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:43.106735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:43.136813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a05b0-1ce8-4039-a86b-14443dbbebf3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:43.141773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:43.142662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.143133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.143468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] PATH_INFO: `/v3/users/b18fe42493064b8a96576cfddd7622a0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.144773 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18fe42493064b8a96576cfddd7622a0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:43.146733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:43.194064 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18fe42493064b8a96576cfddd7622a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.206441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18fe42493064b8a96576cfddd7622a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.213716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18fe42493064b8a96576cfddd7622a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.214429 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18fe42493064b8a96576cfddd7622a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.221559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18fe42493064b8a96576cfddd7622a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.227359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1342/2653] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:50:43 2022] DELETE /identity/v3/users/b18fe42493064b8a96576cfddd7622a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:43.231874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.232214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.232490 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.249992 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:43.251190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:43.312511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1312/2654] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:43.322740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:43.324199 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:43.382648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831c86-1b8c-43e0-8019-d02c6f974812 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:43.386340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1722c-8b08-4f63-af05-8c85f51d7a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:43.386989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1722c-8b08-4f63-af05-8c85f51d7a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.387275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1722c-8b08-4f63-af05-8c85f51d7a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.387552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1722c-8b08-4f63-af05-8c85f51d7a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.397309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1722c-8b08-4f63-af05-8c85f51d7a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:43.398770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1722c-8b08-4f63-af05-8c85f51d7a01 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:43.409419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1343/2655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:43.676832 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:43.678366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:43.690878 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37988d-5e72-4cb7-bf1b-4cfd89e75191 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:43.695603 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:43.696571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.696928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.697278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] PATH_INFO: `/v3/projects/7d53253b96f24bc4a90a2e242858a7d3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.698589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d53253b96f24bc4a90a2e242858a7d3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:43.700824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:43.739989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:43.751184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d53253b96f24bc4a90a2e242858a7d3', 'request_id': 'req-c56659ae-fa01-42d6-82aa-8b1212844f16'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.758106 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d53253b96f24bc4a90a2e242858a7d3', 'request_id': 'req-c56659ae-fa01-42d6-82aa-8b1212844f16'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.763650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d53253b96f24bc4a90a2e242858a7d3', 'request_id': 'req-c56659ae-fa01-42d6-82aa-8b1212844f16'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.778842 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] The token cache is being invalidate because project 7d53253b96f24bc4a90a2e242858a7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:50:43.779140 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.779781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c56659ae-fa01-42d6-82aa-8b1212844f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:50:43.781364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1313/2656] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:50:43 2022] DELETE /identity/v3/projects/7d53253b96f24bc4a90a2e242858a7d3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:43.786727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.787149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.787292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.806147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:43.807307 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:43.854730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:43.866835 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1344/2657] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:43.874602 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.875118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.875222 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.894078 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:43.895279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:43.903948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1314/2658] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:43.907641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:43.919648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef766e-9be0-4ff3-ae1d-ffe321061a2a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:43.924646 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:43.926013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.926320 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.926604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.927942 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:50:43.928502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:43.931251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:43.944674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1345/2659] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:50:43.949145 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:43.958991 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c96dde-54b7-4cb9-a142-2ebbe092bc8b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:43.963684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:43.964362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:43.964653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:43.964931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:43.966116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:43.968073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:43.993176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1315/2660] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:50:43 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:43.997226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:44.007530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2521d79-16d0-4a80-97c8-f435f8cc907a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:44.062446 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:44.063025 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:44.063309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:44.063581 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:44.064285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:44.066459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:44.086754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1346/2661] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:50:43 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:50:44.090778 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:44.101969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529934-046f-4213-bdf2-4adf0c80b65e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:44.106585 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:44.107234 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:44.107518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:44.107796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:44.108558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:44.110153 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:44.120684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1316/2662] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:44.124654 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:44.134937 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c16fcd-654b-485d-9671-7001d5fc13ba admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:44.139549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da074e97-be2c-488f-82ce-1d60cf69833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:44.140238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da074e97-be2c-488f-82ce-1d60cf69833f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:44.140526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da074e97-be2c-488f-82ce-1d60cf69833f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:44.140800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da074e97-be2c-488f-82ce-1d60cf69833f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:44.141520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da074e97-be2c-488f-82ce-1d60cf69833f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:44.144013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da074e97-be2c-488f-82ce-1d60cf69833f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:44.154170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1347/2663] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:50:44.158237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:44.168297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2a87-614f-46f9-86e5-e9d0060c193f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:44.172900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:44.173771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:44.174057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:44.174544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] PATH_INFO: `/v3/projects/abb96ad569b94469a56710e1b3c76430/users/8765496e71914c7ea21d5e9dae7b5649/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:44.189638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb96ad569b94469a56710e1b3c76430, user_id=8765496e71914c7ea21d5e9dae7b5649, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:44.193028 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:44.206279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1317/2664] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:50:44 2022] PUT /identity/v3/projects/abb96ad569b94469a56710e1b3c76430/users/8765496e71914c7ea21d5e9dae7b5649/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:50:44.217745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:44.218037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:44.218332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:44.244972 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] MFA Rules not processed for user `8765496e71914c7ea21d5e9dae7b5649`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:50:44.246201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:44.309544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1348/2665] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:50:44.321288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:44.323099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:44.381337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b190-dd01-4984-97ab-5cd8aec85dd3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:44.384951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:44.385612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:44.385898 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:44.386177 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:44.395566 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:44.397081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:44.406442 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1318/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:50:54.306433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:54.402099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:59.367134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:50:59.368762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:59.424299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54463100-51cb-4452-9828-e77e9bc6aab3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:50:59.428521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:50:59.429172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:50:59.429462 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:50:59.429741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:50:59.431536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:50:59.441000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:50:59.443131 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a9f7e-2b84-45e9-8732-7421570462c9 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:50:59.451066 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1349/2667] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:50:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:09.242562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:09.322126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da440-c856-4d0a-ac11-16c1f31721b8 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:09.326668 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:09.327532 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:09.327818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:09.328141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] PATH_INFO: `/v3/users/8765496e71914c7ea21d5e9dae7b5649` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:09.329317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8765496e71914c7ea21d5e9dae7b5649)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:09.331251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:09.380979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8765496e71914c7ea21d5e9dae7b5649'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.392694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8765496e71914c7ea21d5e9dae7b5649'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.401372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8765496e71914c7ea21d5e9dae7b5649'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.402082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8765496e71914c7ea21d5e9dae7b5649'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.402684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8765496e71914c7ea21d5e9dae7b5649'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.414969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1319/2668] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:51:09 2022] DELETE /identity/v3/users/8765496e71914c7ea21d5e9dae7b5649 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:09.419574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:09.420107 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:09.420228 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:09.459689 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:09.460954 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:09.524002 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1350/2669] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:09.533541 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:09.534954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:09.603025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:09.616990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c580a-f9b9-41ae-a554-21d009df9a99 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:09.620998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee02d-be70-4595-9d8f-a3f9e41ed049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:09.621638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee02d-be70-4595-9d8f-a3f9e41ed049 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:09.621926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee02d-be70-4595-9d8f-a3f9e41ed049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:09.622208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee02d-be70-4595-9d8f-a3f9e41ed049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:09.632175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee02d-be70-4595-9d8f-a3f9e41ed049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:09.633556 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee02d-be70-4595-9d8f-a3f9e41ed049 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:09.642855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1320/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:09.911392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:09.915046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:09.929912 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a812-20cc-445b-9d13-2d07972bfec6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:09.935863 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:09.936885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:09.937152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:09.937643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] PATH_INFO: `/v3/projects/abb96ad569b94469a56710e1b3c76430` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:09.938867 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb96ad569b94469a56710e1b3c76430)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:09.940905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:09.987195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb96ad569b94469a56710e1b3c76430', 'request_id': 'req-d6b98813-c01b-4b7c-bcf4-028e0e99d433'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.993854 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb96ad569b94469a56710e1b3c76430', 'request_id': 'req-d6b98813-c01b-4b7c-bcf4-028e0e99d433'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:09.999442 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb96ad569b94469a56710e1b3c76430', 'request_id': 'req-d6b98813-c01b-4b7c-bcf4-028e0e99d433'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:10.012866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] The token cache is being invalidate because project abb96ad569b94469a56710e1b3c76430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:51:10.013160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:10.013784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d6b98813-c01b-4b7c-bcf4-028e0e99d433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:10.015368 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1351/2671] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:51:09 2022] DELETE /identity/v3/projects/abb96ad569b94469a56710e1b3c76430 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:51:10.020976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.021262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.021548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.040404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:10.041598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:10.100881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1321/2672] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:10.109661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.109956 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.110239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.128940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:10.130975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:10.138864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1352/2673] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:10.142935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.152687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c36bdd-baf3-442f-901d-9e6e64943cd0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.157363 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125c924-7757-4656-8570-169969cf713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.157958 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125c924-7757-4656-8570-169969cf713b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.158245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125c924-7757-4656-8570-169969cf713b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.158523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125c924-7757-4656-8570-169969cf713b admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.159246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125c924-7757-4656-8570-169969cf713b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:51:10.159559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125c924-7757-4656-8570-169969cf713b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.161866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125c924-7757-4656-8570-169969cf713b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.173390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1322/2674] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:51:10.178198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.182569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:10.189030 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ddc9-7253-473a-99c9-54a1cc90de81 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.194971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.195622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.195946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.196227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.196925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.198865 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.225192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1353/2675] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:10.229309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125c924-7757-4656-8570-169969cf713b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.240225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125c924-7757-4656-8570-169969cf713b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.296488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.297143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.297413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.297688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.298377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.300341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.320538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1323/2676] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:10.324950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.335362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bca04-43c7-487e-b661-d833156041a9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.340437 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.341086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.341369 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.341655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.342371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.344014 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.355331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1354/2677] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:10.359129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.369487 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b0b7-6ddc-4d6d-89c9-d0fef73f7ab0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.374074 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb88f1-010b-4d06-98d5-3b086c3acdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.374721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb88f1-010b-4d06-98d5-3b086c3acdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.375007 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb88f1-010b-4d06-98d5-3b086c3acdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.375286 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb88f1-010b-4d06-98d5-3b086c3acdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.376044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb88f1-010b-4d06-98d5-3b086c3acdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.377632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb88f1-010b-4d06-98d5-3b086c3acdfb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.388211 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1324/2678] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:10.392286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.402731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e333187-9c39-48da-bb56-d721b45977e5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.407453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.408468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.408750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.409022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] PATH_INFO: `/v3/projects/cbd31f519f9a4c9ba05b11a6e18028ad/users/d13e8ae1803545c9b205ab79414d54ec/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.423760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd31f519f9a4c9ba05b11a6e18028ad, user_id=d13e8ae1803545c9b205ab79414d54ec, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.426483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.439726 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1355/2679] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:10 2022] PUT /identity/v3/projects/cbd31f519f9a4c9ba05b11a6e18028ad/users/d13e8ae1803545c9b205ab79414d54ec/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:10.450158 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.450456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.450764 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.478185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] MFA Rules not processed for user `d13e8ae1803545c9b205ab79414d54ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:10.479388 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:10.519241 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:10.547200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1325/2680] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:10.551714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.614333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ec0c3-2a0b-4014-8773-25095ce396a5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.619328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.620039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.620329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.620609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.621328 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.623281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.654042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1356/2681] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:10.655246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.666671 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ef04c-1ee8-4e25-9363-a4b0e278e26b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.724855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.725560 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.725848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.726131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.726820 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.728806 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.749555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1326/2682] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:51:10.753389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.764666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805c080-f952-4691-b500-d29050352d20 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.769364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.770027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.770314 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.770625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.771410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.773067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.786501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1357/2683] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:10.790653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.800685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01489a3e-fea3-4e51-92d2-d2ed5fe81040 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.806798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52f2a-0103-4c65-8403-e4824a594e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.807488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52f2a-0103-4c65-8403-e4824a594e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.807769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52f2a-0103-4c65-8403-e4824a594e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.808112 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52f2a-0103-4c65-8403-e4824a594e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.808868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52f2a-0103-4c65-8403-e4824a594e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.810458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52f2a-0103-4c65-8403-e4824a594e87 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.820751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1327/2684] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:10.824886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:10.834705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a311-365a-4bd3-932a-6b597e047f51 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:10.839408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:10.840317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.840597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.840869 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] PATH_INFO: `/v3/projects/e6d2d313336148e7af4031c8374344e8/users/d28ffa14838c49818471fe1c93e85550/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.856502 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d2d313336148e7af4031c8374344e8, user_id=d28ffa14838c49818471fe1c93e85550, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:10.859204 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:10.872679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1358/2685] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:10 2022] PUT /identity/v3/projects/e6d2d313336148e7af4031c8374344e8/users/d28ffa14838c49818471fe1c93e85550/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:51:10.884090 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:10.884381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:10.884659 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:10.912099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] MFA Rules not processed for user `d28ffa14838c49818471fe1c93e85550`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:10.913323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:10.977596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1328/2686] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:10.981971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.037633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:11.043862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c349fd-bcb3-46e0-a089-e88ff74a3239 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.048910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.049569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.049849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.050121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.050833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.053026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.077586 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1359/2687] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:10 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:11.081605 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.093309 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2739-30d4-4aae-b6ab-590d36b575ef None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.141025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:11.157783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.158464 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.158753 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.159025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.159717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.161690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.194265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1329/2688] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:11 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:11.199123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.209635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056459b3-d524-4928-af01-ab28c1300cf7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.214454 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.215104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.215393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.215669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.216425 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.218031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.228511 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1360/2689] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:11.232381 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.243422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cf264-7e2b-4d05-893e-e28778b4040e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.248013 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.248887 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.249172 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.249446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] PATH_INFO: `/v3/projects/afa512715b444a79b368c4d42bb86237/users/e7cdf515d2fb4207bdc4b0acbc50536c/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.264999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa512715b444a79b368c4d42bb86237, user_id=e7cdf515d2fb4207bdc4b0acbc50536c, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.267693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.280311 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1330/2690] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:11 2022] PUT /identity/v3/projects/afa512715b444a79b368c4d42bb86237/users/e7cdf515d2fb4207bdc4b0acbc50536c/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:11.284194 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.294195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150bf1-d030-48d2-ae4e-2b680284870c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.349141 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86332eae-45dd-4164-ade4-cc00fb4991e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.349802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86332eae-45dd-4164-ade4-cc00fb4991e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.350091 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86332eae-45dd-4164-ade4-cc00fb4991e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.350729 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86332eae-45dd-4164-ade4-cc00fb4991e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.351656 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86332eae-45dd-4164-ade4-cc00fb4991e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.353452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86332eae-45dd-4164-ade4-cc00fb4991e8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.363156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1361/2691] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:11.367926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.379475 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40e50-7594-4c7d-880a-6d1aecb6e24b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.384965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.385838 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.386150 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.386418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] PATH_INFO: `/v3/projects/afa512715b444a79b368c4d42bb86237/users/e7cdf515d2fb4207bdc4b0acbc50536c/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.388425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa512715b444a79b368c4d42bb86237, user_id=e7cdf515d2fb4207bdc4b0acbc50536c, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.391077 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.401076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1331/2692] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:11 2022] PUT /identity/v3/projects/afa512715b444a79b368c4d42bb86237/users/e7cdf515d2fb4207bdc4b0acbc50536c/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:51:11.474094 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.474648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.474648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.502457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] MFA Rules not processed for user `e7cdf515d2fb4207bdc4b0acbc50536c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:11.503651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:11.571658 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1362/2693] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:11.582796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:11.584595 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:11.641397 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08291-6b75-4151-b067-9396a676f69f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:11.645055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:11.645691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:11.645979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:11.646260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:11.707102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:11.708588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:11.718783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1332/2694] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:13.215139 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:13.216536 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:13.229482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919747d-eba4-4a50-b571-1a0790ed3ebb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:13.233022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:13.233641 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:13.233925 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:13.234201 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:13.279395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:13.290790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:13.292278 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:13.300921 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1363/2695] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:13.823772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:13.832483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86d46-bfab-47e5-b9f6-e38bef558a2e service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:13.837265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:13.837903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:13.838190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:13.838492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:13.847903 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:13.849371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:13.859934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1333/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:15.274008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:15.275740 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:15.362662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f6413-9291-4a75-abe3-3549279061ae service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:15.369090 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:15.369752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:15.370043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:15.370324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:15.372160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:15.454079 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:15.455699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:15.478119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1364/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:15.947524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:15.949165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:15.966322 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea955-9f8d-43bf-bdf0-ecd3952c836d service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:15.971802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:15.972471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:15.972757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:15.973035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:15.974796 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:15.987986 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:15.989596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e682aa-ed4f-40e9-92b8-0fd1d5dc6665 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:16.001584 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1334/2698] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:17.713512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:17.768145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:17.780655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d257ab-a5ea-4a9c-adbc-58557a535740 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:17.785279 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:17.786147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:17.786431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:17.786706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] PATH_INFO: `/v3/users/d13e8ae1803545c9b205ab79414d54ec` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:17.788467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13e8ae1803545c9b205ab79414d54ec)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:17.790447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:17.840432 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13e8ae1803545c9b205ab79414d54ec'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:17.853017 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13e8ae1803545c9b205ab79414d54ec'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:17.859936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13e8ae1803545c9b205ab79414d54ec'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:17.860578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13e8ae1803545c9b205ab79414d54ec'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:17.867583 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13e8ae1803545c9b205ab79414d54ec'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:17.873419 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1365/2699] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:51:17 2022] DELETE /identity/v3/users/d13e8ae1803545c9b205ab79414d54ec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:17.878196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:17.878680 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:17.878779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:17.896564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:17.898526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:17.922385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:17.958904 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1335/2700] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:17.969108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:17.970491 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:18.028438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634e93-80a9-457f-a030-d79114757f7f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:18.032134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:18.033148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:18.033148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:18.033393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:18.044172 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:18.045666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:18.056151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1366/2701] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:18.323040 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:18.324515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:18.336716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990559-37f8-4283-b4e3-688b50878253 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:18.341544 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:18.342461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:18.342752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:18.343029 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] PATH_INFO: `/v3/projects/cbd31f519f9a4c9ba05b11a6e18028ad` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:18.344299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd31f519f9a4c9ba05b11a6e18028ad)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:18.346673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:18.392824 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd31f519f9a4c9ba05b11a6e18028ad', 'request_id': 'req-2570d708-2296-4de1-af2d-9580bff537b5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.398933 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd31f519f9a4c9ba05b11a6e18028ad', 'request_id': 'req-2570d708-2296-4de1-af2d-9580bff537b5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.404423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd31f519f9a4c9ba05b11a6e18028ad', 'request_id': 'req-2570d708-2296-4de1-af2d-9580bff537b5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.417635 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] The token cache is being invalidate because project cbd31f519f9a4c9ba05b11a6e18028ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:51:18.417928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.418558 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.421020 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1336/2702] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:51:18 2022] DELETE /identity/v3/projects/cbd31f519f9a4c9ba05b11a6e18028ad => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:18.424959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:18.435548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20be49-a01c-44bb-85ee-82d760973173 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:18.493938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:18.494803 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:18.495086 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:18.495358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] PATH_INFO: `/v3/users/d28ffa14838c49818471fe1c93e85550` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:18.496518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28ffa14838c49818471fe1c93e85550)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:18.498499 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:18.512441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:18.544754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28ffa14838c49818471fe1c93e85550'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.557908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28ffa14838c49818471fe1c93e85550'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.564697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28ffa14838c49818471fe1c93e85550'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.565310 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28ffa14838c49818471fe1c93e85550'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.572303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28ffa14838c49818471fe1c93e85550'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:18.578105 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1367/2703] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:51:18 2022] DELETE /identity/v3/users/d28ffa14838c49818471fe1c93e85550 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:18.932034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:18.933593 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:18.948621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d708-2296-4de1-af2d-9580bff537b5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:19.009918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:19.010977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:19.011334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:19.011681 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] PATH_INFO: `/v3/projects/e6d2d313336148e7af4031c8374344e8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:19.012999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d2d313336148e7af4031c8374344e8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:19.015116 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:19.067043 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d2d313336148e7af4031c8374344e8', 'request_id': 'req-467c9fa4-9169-4ad5-8745-2afa69725c70'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.074195 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d2d313336148e7af4031c8374344e8', 'request_id': 'req-467c9fa4-9169-4ad5-8745-2afa69725c70'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.075449 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:19.081344 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d2d313336148e7af4031c8374344e8', 'request_id': 'req-467c9fa4-9169-4ad5-8745-2afa69725c70'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.095463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] The token cache is being invalidate because project e6d2d313336148e7af4031c8374344e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:51:19.095667 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.096323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.097875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1337/2704] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:51:18 2022] DELETE /identity/v3/projects/e6d2d313336148e7af4031c8374344e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:19.102687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:19.104115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:19.122347 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec22d-0590-44e6-8307-9d82bee67f99 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:19.129738 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:19.132224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:19.180226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:19.181121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:19.181408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:19.181714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] PATH_INFO: `/v3/users/e7cdf515d2fb4207bdc4b0acbc50536c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:19.182918 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cdf515d2fb4207bdc4b0acbc50536c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:19.184950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:19.189046 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c9fa4-9169-4ad5-8745-2afa69725c70 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:19.192714 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:19.193358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:19.193648 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:19.194412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:19.196337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:19.233831 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cdf515d2fb4207bdc4b0acbc50536c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.246165 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cdf515d2fb4207bdc4b0acbc50536c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.254109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cdf515d2fb4207bdc4b0acbc50536c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.254878 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cdf515d2fb4207bdc4b0acbc50536c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.261724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:19.262973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cdf515d2fb4207bdc4b0acbc50536c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.263184 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc6ff1-d052-4c78-8b75-721e70f58957 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:19.269274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1368/2705] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:51:19 2022] DELETE /identity/v3/users/e7cdf515d2fb4207bdc4b0acbc50536c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:19.276645 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1338/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:51:19.702520 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:19.704027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:19.717951 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:19.787003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c80bf7-3f4f-489a-8566-5510f5e7c3cb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:19.792245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:19.793115 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:19.793399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:19.793673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] PATH_INFO: `/v3/projects/afa512715b444a79b368c4d42bb86237` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:19.794974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa512715b444a79b368c4d42bb86237)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:19.797009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:19.847378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa512715b444a79b368c4d42bb86237', 'request_id': 'req-552fd10d-1217-4b98-80e3-57e2de2a6616'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.853911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa512715b444a79b368c4d42bb86237', 'request_id': 'req-552fd10d-1217-4b98-80e3-57e2de2a6616'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.860542 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa512715b444a79b368c4d42bb86237', 'request_id': 'req-552fd10d-1217-4b98-80e3-57e2de2a6616'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.874588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] The token cache is being invalidate because project afa512715b444a79b368c4d42bb86237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:51:19.874886 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.875518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-552fd10d-1217-4b98-80e3-57e2de2a6616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:19.877332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1369/2707] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:51:19 2022] DELETE /identity/v3/projects/afa512715b444a79b368c4d42bb86237 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:19.882810 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:19.883105 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:19.883423 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:19.901937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:19.903419 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:19.967891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1339/2708] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:19.976338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:19.976717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:19.977121 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:19.996464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:19.997816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:20.006631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1370/2709] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:20.011312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.020963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a0589-790f-4c85-ab9a-69e46247d293 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.026237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.027034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.027316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.027591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.028369 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:51:20.028684 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.030290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.042375 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1340/2710] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:51:20.046981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.061873 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cf19c-3c78-4d04-966f-bd2397c14e27 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.067390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.068101 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.068389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.068657 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.069380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.071322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.098180 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1371/2711] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:20 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:20.102326 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.112625 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb601b2-2fd7-4005-86ed-f083ecac8e1f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.129679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:20.172526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.173200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.173479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.173750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.174447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.176387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.197054 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1341/2712] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:20 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:20.201062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.212104 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f937-7638-46ce-a4b4-63ab22c688cd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.216796 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.217478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.217764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.218040 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.218780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.220453 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.235825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1372/2713] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:20.237533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.249133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3bd24-a9be-4583-bdb9-85ee38fb758e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.254237 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da232b1-2c93-4146-b9f4-e5158399c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.255003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da232b1-2c93-4146-b9f4-e5158399c94e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.255599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da232b1-2c93-4146-b9f4-e5158399c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.255983 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da232b1-2c93-4146-b9f4-e5158399c94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.257403 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da232b1-2c93-4146-b9f4-e5158399c94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.259104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da232b1-2c93-4146-b9f4-e5158399c94e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.270569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1342/2714] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:20.275048 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.285664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092e6ed-6c9e-44cd-877c-7ee98210bea4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.290496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.291412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.291703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.292055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] PATH_INFO: `/v3/projects/6be45c6791274b4c9f58753498a1684d/users/b183452d65b94bb0b0ce507cc9db4d08/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.308680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be45c6791274b4c9f58753498a1684d, user_id=b183452d65b94bb0b0ce507cc9db4d08, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.311482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.326612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1373/2715] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:20 2022] PUT /identity/v3/projects/6be45c6791274b4c9f58753498a1684d/users/b183452d65b94bb0b0ce507cc9db4d08/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:20.331874 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc3ca-c562-47f2-a286-82b8827f3253 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.332283 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc3ca-c562-47f2-a286-82b8827f3253 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.332636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc3ca-c562-47f2-a286-82b8827f3253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.352002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-671fc3ca-c562-47f2-a286-82b8827f3253 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:20.353232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-671fc3ca-c562-47f2-a286-82b8827f3253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:20.416143 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1343/2716] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:20.425677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:20.427447 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:20.470915 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:20.489823 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab67fc-a5e7-4e46-89bd-04dc5de488aa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:20.494282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:20.494939 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:20.495231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:20.495533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:20.507585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:20.508993 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:20.518910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1374/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:25.043037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.043896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.044338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.089088 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] MFA Rules not processed for user `b183452d65b94bb0b0ce507cc9db4d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:25.090454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:25.192107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1344/2718] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:25.195227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:25.208185 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993439b3-f206-4177-858a-7ce01facae23 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:25.218887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:25.219574 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.219884 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.220168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.220887 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:25.222841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:25.290087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:25.291316 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1375/2719] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:25 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:25.308392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebd3ac-b1c1-41a7-bb2b-30e30df07665 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:25.345068 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:25.405269 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:25.405946 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.406232 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.406509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.407208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:25.409249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:25.435613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1345/2720] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:25 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:25.439554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:25.450031 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6145-b52e-4f55-b92e-b612dcecb1eb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:25.454868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:25.455550 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.455866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.456151 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.456896 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:25.458603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:25.471720 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1376/2721] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:25.476969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:25.487741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035c0e-dff6-48b8-bbd9-5464f51dea5e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:25.493350 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:25.494371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.494718 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.495065 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] PATH_INFO: `/v3/projects/7bfa26bfeace463f95e3fd94d71b6be5/users/7511d5994c274c9697a9c4da605c2af5/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.511896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfa26bfeace463f95e3fd94d71b6be5, user_id=7511d5994c274c9697a9c4da605c2af5, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:25.515360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:25.531327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1346/2722] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:25 2022] PUT /identity/v3/projects/7bfa26bfeace463f95e3fd94d71b6be5/users/7511d5994c274c9697a9c4da605c2af5/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:25.535352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:25.545975 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2d8bc-aa9e-4fbe-ac40-c8ca8937287a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:25.606589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040b97-6790-499e-87cd-159da0249e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:25.607304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040b97-6790-499e-87cd-159da0249e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.607594 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040b97-6790-499e-87cd-159da0249e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.607985 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040b97-6790-499e-87cd-159da0249e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.608735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040b97-6790-499e-87cd-159da0249e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:25.610366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040b97-6790-499e-87cd-159da0249e99 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:25.622145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1377/2723] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:25.626493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:25.638274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588c755-5568-4b31-ba89-47e018124d0d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:25.643018 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:25.643953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:25.644240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:25.644517 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] PATH_INFO: `/v3/projects/7bfa26bfeace463f95e3fd94d71b6be5/users/7511d5994c274c9697a9c4da605c2af5/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:25.646574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfa26bfeace463f95e3fd94d71b6be5, user_id=7511d5994c274c9697a9c4da605c2af5, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:25.650263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:25.661374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1347/2724] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:25 2022] PUT /identity/v3/projects/7bfa26bfeace463f95e3fd94d71b6be5/users/7511d5994c274c9697a9c4da605c2af5/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:30.942392 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8f44b-5776-4e21-8b6d-d4fe316477e4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:30.943349 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8f44b-5776-4e21-8b6d-d4fe316477e4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:30.944702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8f44b-5776-4e21-8b6d-d4fe316477e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:30.986081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-50e8f44b-5776-4e21-8b6d-d4fe316477e4 None None] MFA Rules not processed for user `7511d5994c274c9697a9c4da605c2af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:30.987731 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-50e8f44b-5776-4e21-8b6d-d4fe316477e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:31.081170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1378/2725] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:31.093954 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:31.095694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:31.169775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135251d-a5a5-474c-93d3-2b7f1b348edc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:31.173788 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6c2d367804ad5b3802d487efb13ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:31.174457 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:31.174888 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:31.175175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:31.243070 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:31.244609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:31.254259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1348/2726] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:31.357829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:31.358252 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:31.359377 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:31.411871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:31.437984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:31.439263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:31.515436 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1379/2727] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:51:31.565524 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:31.567066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:31.611462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:31.668368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cfe4-8f95-4ce2-a959-fa14cd7ec2b3 service glance] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:31.673492 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda07669-5dc3-462a-9488-46c4939cdf40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:31.674163 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07669-5dc3-462a-9488-46c4939cdf40 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:31.674450 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07669-5dc3-462a-9488-46c4939cdf40 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:31.674731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07669-5dc3-462a-9488-46c4939cdf40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:31.683956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07669-5dc3-462a-9488-46c4939cdf40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:31.685826 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07669-5dc3-462a-9488-46c4939cdf40 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:31.694770 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1349/2728] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:36.820323 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:36.947122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcca179-b011-4e97-b62a-8aaac28e8805 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:36.952043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:36.953020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:36.953549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:36.954061 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:36.965562 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:37.088859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:37.090526 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:37.115240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1380/2729] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:41.388461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80384-3115-444c-a8fb-72f586046816 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:41.388865 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80384-3115-444c-a8fb-72f586046816 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:41.389179 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80384-3115-444c-a8fb-72f586046816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:41.432827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-04d80384-3115-444c-a8fb-72f586046816 None None] MFA Rules not processed for user `b183452d65b94bb0b0ce507cc9db4d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:41.434262 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-04d80384-3115-444c-a8fb-72f586046816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:41.441678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1350/2730] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:41.547958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:41.551696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:41.564958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36a60-2f14-4398-8c73-da32bf0965de service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:41.571380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:41.572168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:41.572630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:41.573036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] PATH_INFO: `/v3/users/bfa74308096d40daac0a67c9ebec8d8d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:41.574341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa74308096d40daac0a67c9ebec8d8d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:41.576371 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:41.622741 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:41.633331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa74308096d40daac0a67c9ebec8d8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:41.649478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa74308096d40daac0a67c9ebec8d8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:41.657961 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa74308096d40daac0a67c9ebec8d8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:41.658647 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa74308096d40daac0a67c9ebec8d8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:41.665737 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b629e28f-cbe9-42ac-b819-3bbdf0dcd650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa74308096d40daac0a67c9ebec8d8d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:41.671778 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1381/2731] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:51:41 2022] DELETE /identity/v3/users/bfa74308096d40daac0a67c9ebec8d8d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:41.890939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80384-3115-444c-a8fb-72f586046816 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:41.910638 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80384-3115-444c-a8fb-72f586046816 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:41.977034 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:41.977895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:41.978182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:41.978459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] PATH_INFO: `/v3/projects/28351bd81f5f497a829c67c15bbb2f09` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:41.979647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28351bd81f5f497a829c67c15bbb2f09)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:41.981596 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.034285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28351bd81f5f497a829c67c15bbb2f09', 'request_id': 'req-51367ec7-56e5-493b-91df-2b2811c60523'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:42.041960 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28351bd81f5f497a829c67c15bbb2f09', 'request_id': 'req-51367ec7-56e5-493b-91df-2b2811c60523'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:42.054099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28351bd81f5f497a829c67c15bbb2f09', 'request_id': 'req-51367ec7-56e5-493b-91df-2b2811c60523'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:42.069404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] The token cache is being invalidate because project 28351bd81f5f497a829c67c15bbb2f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:51:42.069756 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:42.070480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51367ec7-56e5-493b-91df-2b2811c60523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:42.072079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1351/2732] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:51:41 2022] DELETE /identity/v3/projects/28351bd81f5f497a829c67c15bbb2f09 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:42.078366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.079191 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.080396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.160376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:42.161459 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:42.223521 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1382/2733] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:51:42.233024 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.233661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.234347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.255539 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:42.257931 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:42.268479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1352/2734] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:42.273370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.282950 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37a20b-4330-4ca4-8788-a80e05204332 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.288621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.289481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.289829 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.290171 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.290967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:51:42.291352 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.293072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.307216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1383/2735] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:51:42.311270 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.320743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352af7-be82-430d-a398-d1b1ba4247be None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.325382 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.326031 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.326314 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.326594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.327337 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.329355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.350108 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:42.359062 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1353/2736] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:42 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:42.363193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.375246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7bf60-578b-4b88-bd13-b2590d818b57 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.440067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.440754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.441036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.441312 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.447166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.447166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.467945 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1384/2737] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:42 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:42.472452 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.483204 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a7c8a-57a9-45ae-940c-d387451cef7e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.487772 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.488458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.488740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.489016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.489743 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.491531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.502821 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1354/2738] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:51:42.508699 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.520675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5432199-fa72-4bf6-bdf9-e852b4c2f5d2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.526487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.527148 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.527433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.527710 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.528471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.530075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.531382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:42.545537 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1385/2739] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:42.549766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.561480 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d11ef3-677e-4d03-82e9-97f12c5db8b8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.567048 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7132a3-05a1-46f8-bce3-e2a54799c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.567978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7132a3-05a1-46f8-bce3-e2a54799c9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.568264 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7132a3-05a1-46f8-bce3-e2a54799c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.569368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7132a3-05a1-46f8-bce3-e2a54799c9fa admin admin] PATH_INFO: `/v3/projects/4549b943b3ae4304ace38051cc0e4ef0/users/17f890210c4c48f7a5edddd27ad9135d/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.586116 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.587287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7132a3-05a1-46f8-bce3-e2a54799c9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4549b943b3ae4304ace38051cc0e4ef0, user_id=17f890210c4c48f7a5edddd27ad9135d, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.588142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:42.590257 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7132a3-05a1-46f8-bce3-e2a54799c9fa admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.604485 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1355/2740] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:42 2022] PUT /identity/v3/projects/4549b943b3ae4304ace38051cc0e4ef0/users/17f890210c4c48f7a5edddd27ad9135d/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:42.617649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.617948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.618229 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.646030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] MFA Rules not processed for user `17f890210c4c48f7a5edddd27ad9135d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:42.647848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:42.685283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628af7b-6bc5-4b95-a492-be086d3c905c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.714911 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1356/2741] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:42.727121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:42.728515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:42.748839 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.749503 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.749794 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.750075 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.754232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:42.767298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.768862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4540b-4409-4e82-97d6-afe89056a063 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.779266 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1386/2742] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:51:42.806564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeaa74-e27e-4028-82b7-bfaa32cf53f3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:42.813026 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:42.813677 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:42.813965 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:42.814245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:42.823327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:42.824952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:42.834072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1357/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 18:51:43.487821 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:43.488195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:43.488519 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:43.506893 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:43.508150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:43.567804 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1387/2744] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:43.581618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:43.583079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:43.633122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:43.660246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace23c5-1281-4a58-8a65-2cfbbd51ac2e service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:43.665297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9c8af-f117-47c9-a80e-5df6b1345175 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:43.665941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c8af-f117-47c9-a80e-5df6b1345175 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:43.666224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c8af-f117-47c9-a80e-5df6b1345175 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:43.666500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c8af-f117-47c9-a80e-5df6b1345175 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:43.674982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9c8af-f117-47c9-a80e-5df6b1345175 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:43.676612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9c8af-f117-47c9-a80e-5df6b1345175 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:43.685578 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1358/2745] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:53.561250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:53.682473 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=14 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:54.550037 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:54.615816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b5684-1989-44c6-8004-3c9db5847f0f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:54.620282 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:54.621167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:54.621540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:54.621709 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] PATH_INFO: `/v3/users/17f890210c4c48f7a5edddd27ad9135d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:54.623027 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f890210c4c48f7a5edddd27ad9135d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:54.625007 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:54.670898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f890210c4c48f7a5edddd27ad9135d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:54.682777 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f890210c4c48f7a5edddd27ad9135d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:54.690052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f890210c4c48f7a5edddd27ad9135d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:54.690733 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f890210c4c48f7a5edddd27ad9135d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:54.698669 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f890210c4c48f7a5edddd27ad9135d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:54.704570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1388/2746] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:51:54 2022] DELETE /identity/v3/users/17f890210c4c48f7a5edddd27ad9135d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:54.709196 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:54.709739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:54.709739 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:54.727335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:54.728500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:54.790825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1359/2747] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:51:54.800440 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:54.801813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:54.858736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bb7b8-d86c-451d-a0f1-8e3faa88ea95 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:54.862690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765d727-5685-4511-b6bb-6e1649e8f276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:54.863336 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765d727-5685-4511-b6bb-6e1649e8f276 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:54.863624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765d727-5685-4511-b6bb-6e1649e8f276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:54.864024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765d727-5685-4511-b6bb-6e1649e8f276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:54.873137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765d727-5685-4511-b6bb-6e1649e8f276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:54.874591 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765d727-5685-4511-b6bb-6e1649e8f276 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:54.885145 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1389/2748] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:55.164766 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.166199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:55.178956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253d620-6a69-45e8-8336-2c47a22f6eb1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.184308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.185385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.185721 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.186003 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] PATH_INFO: `/v3/projects/4549b943b3ae4304ace38051cc0e4ef0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.187294 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4549b943b3ae4304ace38051cc0e4ef0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.189165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.250981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4549b943b3ae4304ace38051cc0e4ef0', 'request_id': 'req-05e0516c-ece9-443f-98f2-852536a1e288'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:55.258984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4549b943b3ae4304ace38051cc0e4ef0', 'request_id': 'req-05e0516c-ece9-443f-98f2-852536a1e288'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:55.266181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4549b943b3ae4304ace38051cc0e4ef0', 'request_id': 'req-05e0516c-ece9-443f-98f2-852536a1e288'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:55.280574 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] The token cache is being invalidate because project 4549b943b3ae4304ace38051cc0e4ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:51:55.280872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:55.282348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-05e0516c-ece9-443f-98f2-852536a1e288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:51:55.283950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1360/2749] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:51:55 2022] DELETE /identity/v3/projects/4549b943b3ae4304ace38051cc0e4ef0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:55.289319 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.289616 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.289898 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.309822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:55.311036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:55.330673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:55.383415 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1390/2750] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:55.391149 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f208-a814-452b-8eb5-141face45e6b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.391445 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f208-a814-452b-8eb5-141face45e6b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.391724 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f208-a814-452b-8eb5-141face45e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.414893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9135f208-a814-452b-8eb5-141face45e6b None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:55.416161 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9135f208-a814-452b-8eb5-141face45e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:55.425599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1361/2751] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:55.430551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.440946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbedea-ce35-44a1-82a6-fddd9b75ac0e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.446130 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.446880 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.447166 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.447445 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.448280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:51:55.448644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.450321 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.467149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1391/2752] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 18:51:55.468470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f208-a814-452b-8eb5-141face45e6b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.478775 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f208-a814-452b-8eb5-141face45e6b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.483955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.484629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.484910 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.485245 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.485951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.487952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.517968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1362/2753] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:55 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:55.522958 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.538464 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9b39-6c26-4a79-bdbf-381d604a5c54 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.614359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.615072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.615072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.615072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.615072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.615072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.640053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1392/2754] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:55 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:55.644193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.657783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054f9bb-8f47-4bff-907d-07e3a149ce78 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.663171 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.663777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.664100 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.664385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.665121 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.666740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.679407 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1363/2755] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:55.683438 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.695146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417baad-6d7b-4520-b1e0-de395e7fb01f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.700158 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86279a0b-cb76-4a88-a928-1a2e808a5f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.700816 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279a0b-cb76-4a88-a928-1a2e808a5f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.701096 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279a0b-cb76-4a88-a928-1a2e808a5f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.701373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279a0b-cb76-4a88-a928-1a2e808a5f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.702103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86279a0b-cb76-4a88-a928-1a2e808a5f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.703713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86279a0b-cb76-4a88-a928-1a2e808a5f15 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.716122 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1393/2756] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:55.725899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.737293 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2b8f-1800-4c7f-866d-25324298cbee admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.743137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.744126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.744409 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.744685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] PATH_INFO: `/v3/projects/b227cc3150aa42dd9e19e1cd5108a430/users/3b0b0251bf744dc3a66889a1f800c2ff/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.769089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b227cc3150aa42dd9e19e1cd5108a430, user_id=3b0b0251bf744dc3a66889a1f800c2ff, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.771893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:55.786591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1364/2757] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:55 2022] PUT /identity/v3/projects/b227cc3150aa42dd9e19e1cd5108a430/users/3b0b0251bf744dc3a66889a1f800c2ff/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:55.798739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.799026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.799303 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.828343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] MFA Rules not processed for user `3b0b0251bf744dc3a66889a1f800c2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:55.829874 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:55.895640 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1394/2758] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:55.900422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:55.921670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:55.975961 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89375-d6b6-46b3-9d1a-29355822c8cb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:55.980823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:55.981483 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:55.981767 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:55.982042 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:55.982790 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:55.985057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.011274 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1365/2759] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:51:55 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:51:56.015509 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.026629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af4e61-2b3c-4bb7-9ffd-ae801076cb7d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.038673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:56.085035 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.085788 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.086076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.086355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.087054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.089059 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.111506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1395/2760] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:51:56 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:51:56.115451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.126278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baaa60-8efc-4c65-a558-88c1453641fd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.130813 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.131822 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.132127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.132400 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.133129 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.134717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.145300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1366/2761] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:56.149452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.159486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c51e63-75fd-4e12-91fd-07a48ae8f0ff admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.164666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.165706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.166019 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.166295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] PATH_INFO: `/v3/projects/2b013b2c9755405eb5f271d235c41812/users/4530b307787f4d029c5ba138206e013d/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.181621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b013b2c9755405eb5f271d235c41812, user_id=4530b307787f4d029c5ba138206e013d, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.184380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.196997 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1396/2762] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:56 2022] PUT /identity/v3/projects/2b013b2c9755405eb5f271d235c41812/users/4530b307787f4d029c5ba138206e013d/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:51:56.200900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.211368 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91eaa-a823-4b4a-b4fb-03257409bd24 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.272413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850301c-c2ad-4f01-9824-cec97d050db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.273096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850301c-c2ad-4f01-9824-cec97d050db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.273387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850301c-c2ad-4f01-9824-cec97d050db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.273785 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850301c-c2ad-4f01-9824-cec97d050db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.274750 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850301c-c2ad-4f01-9824-cec97d050db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.277598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850301c-c2ad-4f01-9824-cec97d050db6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.289512 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1367/2763] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:51:56.293652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.304637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ed96-5ce1-4bb8-afe4-f8f40e419791 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.309123 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.310013 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.310295 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.310565 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] PATH_INFO: `/v3/projects/2b013b2c9755405eb5f271d235c41812/users/4530b307787f4d029c5ba138206e013d/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.312570 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b013b2c9755405eb5f271d235c41812, user_id=4530b307787f4d029c5ba138206e013d, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.315450 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.326768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1397/2764] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:51:56 2022] PUT /identity/v3/projects/2b013b2c9755405eb5f271d235c41812/users/4530b307787f4d029c5ba138206e013d/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:51:56.337906 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.338193 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.338469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.366818 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] MFA Rules not processed for user `4530b307787f4d029c5ba138206e013d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:51:56.368119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:56.436318 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1368/2765] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:51:56.448230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.450000 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:51:56.529567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51c94-dce4-4c17-b6a5-ae61ee764751 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.533179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.533822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.534108 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.534390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.543577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.545058 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.555134 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1398/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:51:56.624567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:51:56.635187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8454b-85be-4257-b546-36a14cfbeb1d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:51:56.638771 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f649e-fac4-4172-8bd8-1abbceeb1758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:51:56.639399 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f649e-fac4-4172-8bd8-1abbceeb1758 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:51:56.639687 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f649e-fac4-4172-8bd8-1abbceeb1758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:51:56.640001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f649e-fac4-4172-8bd8-1abbceeb1758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:51:56.652649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:56.699499 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f649e-fac4-4172-8bd8-1abbceeb1758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:51:56.700977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f649e-fac4-4172-8bd8-1abbceeb1758 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:51:56.710288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1369/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:06.533622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:06.585673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:06.597026 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a5f92-72f5-4a95-9a8b-47f2fc21dab4 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:06.602334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:06.603202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:06.603487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:06.603763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] PATH_INFO: `/v3/users/3b0b0251bf744dc3a66889a1f800c2ff` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:06.605003 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0b0251bf744dc3a66889a1f800c2ff)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:06.607119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:06.651467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0b0251bf744dc3a66889a1f800c2ff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:06.663424 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0b0251bf744dc3a66889a1f800c2ff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:06.670477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0b0251bf744dc3a66889a1f800c2ff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:06.671085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0b0251bf744dc3a66889a1f800c2ff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:06.677848 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0b0251bf744dc3a66889a1f800c2ff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:06.684556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1399/2768] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:06 2022] DELETE /identity/v3/users/3b0b0251bf744dc3a66889a1f800c2ff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:06.689064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:06.689565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:06.689691 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:06.708459 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:06.710142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:06.776751 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1370/2769] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:06.786493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:06.788767 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:06.853039 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce9ba-67f3-4f44-8948-da3269c97678 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:06.856313 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:06.856971 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:06.857254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:06.857531 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:06.868021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:06.869490 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:06.879988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1400/2770] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:07.647398 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:07.649414 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:07.666713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1544a-8c2e-46c9-818e-26ea834a4186 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:07.672404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:07.673308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:07.673591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:07.673867 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] PATH_INFO: `/v3/projects/b227cc3150aa42dd9e19e1cd5108a430` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:07.675686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b227cc3150aa42dd9e19e1cd5108a430)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:07.678702 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:07.734231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b227cc3150aa42dd9e19e1cd5108a430', 'request_id': 'req-6b25abc4-20e0-41bf-a417-4c06d5b3765d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.742186 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b227cc3150aa42dd9e19e1cd5108a430', 'request_id': 'req-6b25abc4-20e0-41bf-a417-4c06d5b3765d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.756855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b227cc3150aa42dd9e19e1cd5108a430', 'request_id': 'req-6b25abc4-20e0-41bf-a417-4c06d5b3765d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.780927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] The token cache is being invalidate because project b227cc3150aa42dd9e19e1cd5108a430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:07.781282 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.782019 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.784005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1371/2771] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:07 2022] DELETE /identity/v3/projects/b227cc3150aa42dd9e19e1cd5108a430 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:07.787736 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:07.797588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9faafc-72af-47e5-86cb-d86c9e7f779b service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:07.855602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:07.856624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:07.856980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:07.857326 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] PATH_INFO: `/v3/users/4530b307787f4d029c5ba138206e013d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:07.858626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4530b307787f4d029c5ba138206e013d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:07.860708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:07.877259 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:07.910359 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4530b307787f4d029c5ba138206e013d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.922643 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4530b307787f4d029c5ba138206e013d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.931284 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4530b307787f4d029c5ba138206e013d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.932408 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4530b307787f4d029c5ba138206e013d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.942208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a20505c-5b54-450b-8ea4-83c545b0743f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4530b307787f4d029c5ba138206e013d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:07.951866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1401/2772] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:07 2022] DELETE /identity/v3/users/4530b307787f4d029c5ba138206e013d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:52:08.251624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.253358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:08.268123 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25abc4-20e0-41bf-a417-4c06d5b3765d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.304654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:08.330053 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.330917 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.331206 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.331522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] PATH_INFO: `/v3/projects/2b013b2c9755405eb5f271d235c41812` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.332798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b013b2c9755405eb5f271d235c41812)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.335716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.384615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b013b2c9755405eb5f271d235c41812', 'request_id': 'req-6006321b-b8f1-44ee-840e-301e237170e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:08.390758 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b013b2c9755405eb5f271d235c41812', 'request_id': 'req-6006321b-b8f1-44ee-840e-301e237170e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:08.396496 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b013b2c9755405eb5f271d235c41812', 'request_id': 'req-6006321b-b8f1-44ee-840e-301e237170e4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:08.409000 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] The token cache is being invalidate because project 2b013b2c9755405eb5f271d235c41812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:08.409329 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:08.409989 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6006321b-b8f1-44ee-840e-301e237170e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:08.411537 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1372/2773] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:08 2022] DELETE /identity/v3/projects/2b013b2c9755405eb5f271d235c41812 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:08.416575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.416868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.417168 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.436300 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:08.437501 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:08.494665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1402/2774] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:08.502215 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c5711-29b7-4168-b198-457680f33b98 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.502509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c5711-29b7-4168-b198-457680f33b98 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.502791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c5711-29b7-4168-b198-457680f33b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.521609 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-137c5711-29b7-4168-b198-457680f33b98 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:08.522834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-137c5711-29b7-4168-b198-457680f33b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:08.530731 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1373/2775] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:08.534789 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.544398 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67028f9d-0b70-476e-8b34-35181645bc8f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.549005 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.549648 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.549936 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.550216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.550940 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:52:08.551251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.553399 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.564577 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1403/2776] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:52:08.569339 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c5711-29b7-4168-b198-457680f33b98 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.578380 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c5711-29b7-4168-b198-457680f33b98 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.582979 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.583613 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.583930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.584520 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.585228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.587131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.614115 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1374/2777] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:08 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:52:08.618727 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.628908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176eb87-5eb0-4b0a-859d-91ecae0da6b9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.685579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.686256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.686544 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.686970 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.687703 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.689686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.710288 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1404/2778] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:08 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:08.714468 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.725176 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19dbc-2ada-4f35-b313-aaba4e87cce9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.730343 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.730998 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.731285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.731564 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.732327 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.733948 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.745737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1375/2779] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:08.749644 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.760411 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57e0e-a95c-410a-ab5c-ff985ddcdca6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.765036 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9520ab-18cf-4874-80e7-27c214b7c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.765690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9520ab-18cf-4874-80e7-27c214b7c9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.765983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9520ab-18cf-4874-80e7-27c214b7c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.766263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9520ab-18cf-4874-80e7-27c214b7c9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.767011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9520ab-18cf-4874-80e7-27c214b7c9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.768655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9520ab-18cf-4874-80e7-27c214b7c9ea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.773891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:08.779714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1405/2780] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:08.784384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:08.794470 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54be9a2-0486-47c4-9a2c-390b59677dc5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:08.799058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:08.799963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.800253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.800531 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] PATH_INFO: `/v3/projects/393b0bc70a2c4b3691e53c2ef2f41d7f/users/aaa60646802e4df2b24c8bf4827dacf6/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.815361 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393b0bc70a2c4b3691e53c2ef2f41d7f, user_id=aaa60646802e4df2b24c8bf4827dacf6, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:08.818126 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:08.831791 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1376/2781] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:08 2022] PUT /identity/v3/projects/393b0bc70a2c4b3691e53c2ef2f41d7f/users/aaa60646802e4df2b24c8bf4827dacf6/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:08.842911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:08.843420 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:08.843580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:08.869766 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] MFA Rules not processed for user `aaa60646802e4df2b24c8bf4827dacf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:08.870952 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:08.937813 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1406/2782] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:08.942686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.013372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bddde-0139-4aab-9bc2-428bb9b5d894 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.018513 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.019170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.019515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.019794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.020511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.022654 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.031156 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:09.051298 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1377/2783] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:08 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:52:09.055868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.066684 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75dc68-c769-46c4-8a71-93cb38f521e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.124297 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.124978 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.125269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.125552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.126247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.128277 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.147705 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1407/2784] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:09 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:09.151636 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.161685 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269ec-ed50-4c2d-b2ae-1e4458ed1e16 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.166705 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.167334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.167618 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.167929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.168653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.170240 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.181267 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1378/2785] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 18:52:09.185156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.195573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c01b-d705-4e91-92eb-a287918c63d5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.200208 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.201083 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.201370 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.201652 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] PATH_INFO: `/v3/projects/41f3300aea654bdc83b92258515c27d5/users/1f471505f1a54f2f891a7bbbe909d003/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.216859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f3300aea654bdc83b92258515c27d5, user_id=1f471505f1a54f2f891a7bbbe909d003, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.219559 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.234808 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1408/2786] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:09 2022] PUT /identity/v3/projects/41f3300aea654bdc83b92258515c27d5/users/1f471505f1a54f2f891a7bbbe909d003/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:09.238901 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.252881 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469ca0-f523-4e03-a1a1-08b9c81305c4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.312576 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0502-7259-45b2-92a0-e0c890e673ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.313415 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0502-7259-45b2-92a0-e0c890e673ad admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.313545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0502-7259-45b2-92a0-e0c890e673ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.313847 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0502-7259-45b2-92a0-e0c890e673ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.314567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0502-7259-45b2-92a0-e0c890e673ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.316347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0502-7259-45b2-92a0-e0c890e673ad admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.330607 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1379/2787] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:09.331899 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.343762 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c895-a114-4375-8c16-de2cfa3b1507 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.348443 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.349333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.349620 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.350649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] PATH_INFO: `/v3/projects/41f3300aea654bdc83b92258515c27d5/users/1f471505f1a54f2f891a7bbbe909d003/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.353142 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f3300aea654bdc83b92258515c27d5, user_id=1f471505f1a54f2f891a7bbbe909d003, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.355851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.367412 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1409/2788] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:09 2022] PUT /identity/v3/projects/41f3300aea654bdc83b92258515c27d5/users/1f471505f1a54f2f891a7bbbe909d003/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:09.377557 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.377852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.378132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.411720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] MFA Rules not processed for user `1f471505f1a54f2f891a7bbbe909d003`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:09.413604 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:09.485182 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1380/2789] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:09.496444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:09.498221 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:09.545949 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:09.559547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc940d-2072-4504-a769-5a001622769a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:09.563630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db8d7d-4a25-497f-a9ee-ed6cd7033d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:09.564317 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db8d7d-4a25-497f-a9ee-ed6cd7033d86 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:09.564608 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db8d7d-4a25-497f-a9ee-ed6cd7033d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:09.565062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db8d7d-4a25-497f-a9ee-ed6cd7033d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:09.575807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db8d7d-4a25-497f-a9ee-ed6cd7033d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:09.577817 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db8d7d-4a25-497f-a9ee-ed6cd7033d86 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:09.589366 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1410/2790] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:09.972748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:10.036839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795c5a-2dae-4953-91f9-1a8c2b164f6a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:10.042035 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:10.042884 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:10.043174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:10.043509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] PATH_INFO: `/v3/users/aaa60646802e4df2b24c8bf4827dacf6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:10.044793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa60646802e4df2b24c8bf4827dacf6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:10.046858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:10.048752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:10.095208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa60646802e4df2b24c8bf4827dacf6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.107930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa60646802e4df2b24c8bf4827dacf6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.116975 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa60646802e4df2b24c8bf4827dacf6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.117741 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa60646802e4df2b24c8bf4827dacf6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.118594 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa60646802e4df2b24c8bf4827dacf6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.132664 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1381/2791] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:09 2022] DELETE /identity/v3/users/aaa60646802e4df2b24c8bf4827dacf6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:10.137299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:10.137801 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:10.137905 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:10.155477 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:10.156745 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:10.214488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1411/2792] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:10.224175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:10.225577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:10.282279 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748c400-e1b3-4a52-ab5e-53981bcbbd96 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:10.285981 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:10.286624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:10.286959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:10.287226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:10.296312 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:10.297752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:10.307893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1382/2793] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:10.582332 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:10.583754 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:10.595994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c460348-bc1e-46a1-810b-25c163a3319a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:10.601140 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:10.602021 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:10.602308 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:10.602589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] PATH_INFO: `/v3/projects/393b0bc70a2c4b3691e53c2ef2f41d7f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:10.603820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=393b0bc70a2c4b3691e53c2ef2f41d7f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:10.606196 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:10.656220 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393b0bc70a2c4b3691e53c2ef2f41d7f', 'request_id': 'req-da39e451-4c7f-4be6-891c-d7cd708f53ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.662667 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393b0bc70a2c4b3691e53c2ef2f41d7f', 'request_id': 'req-da39e451-4c7f-4be6-891c-d7cd708f53ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.668156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393b0bc70a2c4b3691e53c2ef2f41d7f', 'request_id': 'req-da39e451-4c7f-4be6-891c-d7cd708f53ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.680532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] The token cache is being invalidate because project 393b0bc70a2c4b3691e53c2ef2f41d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:10.680822 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.681441 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.682994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1412/2794] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:10 2022] DELETE /identity/v3/projects/393b0bc70a2c4b3691e53c2ef2f41d7f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:10.686938 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:10.696678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98d5af-f2d1-4b4d-8aa3-513d5e5b04f6 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:10.753099 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:10.753972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:10.754254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:10.754526 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] PATH_INFO: `/v3/users/1f471505f1a54f2f891a7bbbe909d003` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:10.755712 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f471505f1a54f2f891a7bbbe909d003)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:10.758352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:10.781551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:10.809359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f471505f1a54f2f891a7bbbe909d003'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.822246 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f471505f1a54f2f891a7bbbe909d003'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.830202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f471505f1a54f2f891a7bbbe909d003'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.830900 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f471505f1a54f2f891a7bbbe909d003'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.831555 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1db67028-0f51-4241-a0fa-940786dc7f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f471505f1a54f2f891a7bbbe909d003'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:10.844032 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1383/2795] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:10 2022] DELETE /identity/v3/users/1f471505f1a54f2f891a7bbbe909d003 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:11.112790 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.114290 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:11.128771 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e451-4c7f-4be6-891c-d7cd708f53ee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.186770 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.187636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.187948 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.188230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] PATH_INFO: `/v3/projects/41f3300aea654bdc83b92258515c27d5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.189416 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f3300aea654bdc83b92258515c27d5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.191353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.201556 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:11.239076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f3300aea654bdc83b92258515c27d5', 'request_id': 'req-355ff098-f3e9-4011-941f-2e8bbe207dd0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:11.246150 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f3300aea654bdc83b92258515c27d5', 'request_id': 'req-355ff098-f3e9-4011-941f-2e8bbe207dd0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:11.251533 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f3300aea654bdc83b92258515c27d5', 'request_id': 'req-355ff098-f3e9-4011-941f-2e8bbe207dd0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:11.263764 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] The token cache is being invalidate because project 41f3300aea654bdc83b92258515c27d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:11.264085 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:11.264708 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-355ff098-f3e9-4011-941f-2e8bbe207dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:11.266231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1413/2796] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:11 2022] DELETE /identity/v3/projects/41f3300aea654bdc83b92258515c27d5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:11.271101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.271606 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.271777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.289934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:11.291187 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:11.348192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1384/2797] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:11.357239 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.357468 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.357746 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.375639 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:11.376947 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:11.385845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1414/2798] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:11.389934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.400844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6c81-4322-48f1-9d9a-c970844a7800 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.405633 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.406280 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.406567 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.406922 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.407662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:52:11.408076 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.409679 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.421500 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1385/2799] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:52:11.425678 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.434907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c418-7741-4f2f-a0f2-fc0c6219b642 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.439554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.440299 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.440588 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.440864 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.441548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.444024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.468587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1415/2800] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:11.472698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.483118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a217cb-2598-49f5-b58f-a751ef94d4cf admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.538220 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.538797 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.539087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.539469 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.540189 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.542131 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.561551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1386/2801] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/users => generated 281 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:11.565599 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.576452 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e66021-37db-47b6-a542-40191af7e356 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.580988 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.581637 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.581919 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.582192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.582911 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.584682 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.594891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1416/2802] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:11.598656 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.610434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84542d75-493e-48ad-91e0-1f4e5cf2aab4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.616974 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125e133-0682-4dd5-a165-50ed409f764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.617632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125e133-0682-4dd5-a165-50ed409f764d admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.617919 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125e133-0682-4dd5-a165-50ed409f764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.618197 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125e133-0682-4dd5-a165-50ed409f764d admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.618926 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125e133-0682-4dd5-a165-50ed409f764d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.620561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125e133-0682-4dd5-a165-50ed409f764d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.631980 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1387/2803] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:11.636337 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.646149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cfb88-fa11-4917-ae40-0b88e967b096 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.651417 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.652342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.652626 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.652902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] PATH_INFO: `/v3/projects/54856c50f759462090ae08cc96326e4b/users/616609a63e4145da91c32ce77a31c1f2/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.667772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54856c50f759462090ae08cc96326e4b, user_id=616609a63e4145da91c32ce77a31c1f2, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.670723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.684807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1417/2804] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:11 2022] PUT /identity/v3/projects/54856c50f759462090ae08cc96326e4b/users/616609a63e4145da91c32ce77a31c1f2/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:11.695643 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.695976 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.696287 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.708207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:11.723081 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] MFA Rules not processed for user `616609a63e4145da91c32ce77a31c1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:11.724359 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:11.790891 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1388/2805] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:11.795260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.855983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f3641-e670-4667-8f47-795f1dc9092f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.860852 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.861451 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.861739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.862022 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.862706 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.864660 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.892227 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1418/2806] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:11.896208 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:11.907612 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261a456-199d-418f-bcff-a93c03aad1fb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:11.963166 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:11.963827 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:11.964137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:11.964412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:11.965113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:11.967036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:11.985984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1389/2807] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:11 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:11.990050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:12.000631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1eee7-1411-435b-95ae-a6268c72979d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:12.005256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:12.006670 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.006962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.007247 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.008042 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:12.009666 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:12.020190 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1419/2808] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:12.024720 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:12.034868 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba853098-05cc-4de4-a8e7-4cf9fe5a156f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:12.039800 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:12.040710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.040978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.041281 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] PATH_INFO: `/v3/projects/e815ef7409cd4d6f8d5522aaefb097ce/users/57bcf2589bb24fa9bf7b10f6b7d425e0/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.055734 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e815ef7409cd4d6f8d5522aaefb097ce, user_id=57bcf2589bb24fa9bf7b10f6b7d425e0, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:12.058434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:12.071610 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1390/2809] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:12 2022] PUT /identity/v3/projects/e815ef7409cd4d6f8d5522aaefb097ce/users/57bcf2589bb24fa9bf7b10f6b7d425e0/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:12.075430 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:12.085280 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f64e6e-2a42-4008-b28b-2cd7d85de15e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:12.089806 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:12.141889 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb95f5-0282-4557-980e-1b268085ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:12.142471 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb95f5-0282-4557-980e-1b268085ace0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.142758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb95f5-0282-4557-980e-1b268085ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.143033 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb95f5-0282-4557-980e-1b268085ace0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.143758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb95f5-0282-4557-980e-1b268085ace0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:12.145391 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb95f5-0282-4557-980e-1b268085ace0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:12.156047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1420/2810] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:12.160284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:12.172479 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342cbbc-dff1-4830-9dfb-34ec6e153b71 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:12.177113 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:12.178107 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.178458 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.178760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] PATH_INFO: `/v3/projects/e815ef7409cd4d6f8d5522aaefb097ce/users/57bcf2589bb24fa9bf7b10f6b7d425e0/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.180793 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e815ef7409cd4d6f8d5522aaefb097ce, user_id=57bcf2589bb24fa9bf7b10f6b7d425e0, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:12.183471 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:12.194367 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1391/2811] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:12 2022] PUT /identity/v3/projects/e815ef7409cd4d6f8d5522aaefb097ce/users/57bcf2589bb24fa9bf7b10f6b7d425e0/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:12.204343 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.204837 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.204977 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.230894 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] MFA Rules not processed for user `57bcf2589bb24fa9bf7b10f6b7d425e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:12.232152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:12.299053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1421/2812] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:12.310955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:12.312760 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:12.364538 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:12.369527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5261-5c31-4ab1-9404-b3f85971d61f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:12.374127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7590ec-92b6-4830-8468-b321027212f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:12.374769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7590ec-92b6-4830-8468-b321027212f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.375057 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7590ec-92b6-4830-8468-b321027212f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.375336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7590ec-92b6-4830-8468-b321027212f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.385253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7590ec-92b6-4830-8468-b321027212f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:12.386716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7590ec-92b6-4830-8468-b321027212f4 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:12.396101 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1392/2813] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:12.797907 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:12.858938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3390a-e07a-48de-ba91-87090dd1ff5b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:12.863467 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:12.864363 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.864653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.864933 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] PATH_INFO: `/v3/users/616609a63e4145da91c32ce77a31c1f2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:12.866716 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616609a63e4145da91c32ce77a31c1f2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:12.868697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:12.905967 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:12.920119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616609a63e4145da91c32ce77a31c1f2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:12.942402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616609a63e4145da91c32ce77a31c1f2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:12.961251 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616609a63e4145da91c32ce77a31c1f2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:12.961891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616609a63e4145da91c32ce77a31c1f2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:12.977478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616609a63e4145da91c32ce77a31c1f2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:12.984008 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1422/2814] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:12 2022] DELETE /identity/v3/users/616609a63e4145da91c32ce77a31c1f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:12.988562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:12.988841 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:12.989147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:13.008170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:13.009383 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:13.067308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1393/2815] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:13.077322 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:13.078694 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:13.135261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f2bb-2849-4d1e-92cf-9c3c5ce14e95 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:13.138962 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:13.139607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:13.139922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:13.140202 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:13.149876 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:13.151358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:13.160757 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1423/2816] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:13.427025 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:13.428864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:13.441893 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b48edd-44a8-43f7-83d9-783b4cc09caf None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:13.447133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:13.448079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:13.448378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:13.448660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] PATH_INFO: `/v3/projects/54856c50f759462090ae08cc96326e4b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:13.449861 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54856c50f759462090ae08cc96326e4b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:13.451859 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:13.497930 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54856c50f759462090ae08cc96326e4b', 'request_id': 'req-acc2f359-660b-4dee-80ed-cb37a76af690'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.503939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54856c50f759462090ae08cc96326e4b', 'request_id': 'req-acc2f359-660b-4dee-80ed-cb37a76af690'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.510412 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54856c50f759462090ae08cc96326e4b', 'request_id': 'req-acc2f359-660b-4dee-80ed-cb37a76af690'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.523064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] The token cache is being invalidate because project 54856c50f759462090ae08cc96326e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:13.523355 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.524017 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.525563 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1394/2817] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:13 2022] DELETE /identity/v3/projects/54856c50f759462090ae08cc96326e4b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:13.529691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:13.539717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d74d-59c3-4156-b10f-a33611226e98 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:13.594478 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:13.595342 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:13.595625 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:13.595930 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] PATH_INFO: `/v3/users/57bcf2589bb24fa9bf7b10f6b7d425e0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:13.597109 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bcf2589bb24fa9bf7b10f6b7d425e0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:13.599054 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:13.644645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bcf2589bb24fa9bf7b10f6b7d425e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.650256 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:13.658137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bcf2589bb24fa9bf7b10f6b7d425e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.665529 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bcf2589bb24fa9bf7b10f6b7d425e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.666156 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bcf2589bb24fa9bf7b10f6b7d425e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.673004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d784aecb-e4c2-4c93-89c0-f2e15c907844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bcf2589bb24fa9bf7b10f6b7d425e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:13.678795 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1424/2818] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:13 2022] DELETE /identity/v3/users/57bcf2589bb24fa9bf7b10f6b7d425e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:13.952461 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:13.954157 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:13.977353 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2f359-660b-4dee-80ed-cb37a76af690 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.038341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.039233 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.039536 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.039811 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] PATH_INFO: `/v3/projects/e815ef7409cd4d6f8d5522aaefb097ce` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.041044 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e815ef7409cd4d6f8d5522aaefb097ce)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.043084 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.060001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:14.091199 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e815ef7409cd4d6f8d5522aaefb097ce', 'request_id': 'req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:14.097089 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e815ef7409cd4d6f8d5522aaefb097ce', 'request_id': 'req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:14.103203 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e815ef7409cd4d6f8d5522aaefb097ce', 'request_id': 'req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:14.116083 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] The token cache is being invalidate because project e815ef7409cd4d6f8d5522aaefb097ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:14.116374 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:14.117509 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0f1235fa-3e4c-46e8-93b9-6b7a32f30aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:14.119087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1395/2819] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:13 2022] DELETE /identity/v3/projects/e815ef7409cd4d6f8d5522aaefb097ce => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:14.123922 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.124219 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.124497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.142991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:14.144235 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:14.202634 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1425/2820] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:14.211622 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.211950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.212236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.232569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:14.233776 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:14.243037 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1396/2821] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:14.247629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.258651 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89ea6-ecd5-460d-aa4a-060082000330 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.263289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.263983 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.264273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.264555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.265286 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:52:14.265603 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.267233 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.278700 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1426/2822] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:52:14.282873 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.294111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f350a-588c-4cb6-a3dd-73c458e1378c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.298729 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.299425 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.299716 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.300132 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.300834 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.302870 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.329727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1397/2823] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:14.335173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.349552 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59db47-acb5-4206-8a35-008611e29e86 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.417262 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.417927 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.418210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.418486 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.419179 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.421147 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.440153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1427/2824] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:14.445551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.456033 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535a0b-0f58-4b8d-9a77-84c09340e8ec admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.461351 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.462011 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.462299 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.462577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.463308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.464942 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.475200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1398/2825] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:14.479406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.489285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca4cd-8217-4e2f-8031-84fa9e72f302 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.494523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd011ddf-639b-4a32-80ee-461d6a06f773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.495173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd011ddf-639b-4a32-80ee-461d6a06f773 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.495456 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd011ddf-639b-4a32-80ee-461d6a06f773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.495734 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd011ddf-639b-4a32-80ee-461d6a06f773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.496488 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd011ddf-639b-4a32-80ee-461d6a06f773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.498088 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd011ddf-639b-4a32-80ee-461d6a06f773 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.508990 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1428/2826] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:14.512977 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.522928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720531f-2f97-49ee-bccb-982fe3f99a74 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.527387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.528288 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.528570 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.528846 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] PATH_INFO: `/v3/projects/0dc830b4abc34bafb0b585ab301c7fae/users/d26034c9607f4b729ac9dfb294124c5a/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.542987 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc830b4abc34bafb0b585ab301c7fae, user_id=d26034c9607f4b729ac9dfb294124c5a, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.545688 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.559239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1399/2827] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:14 2022] PUT /identity/v3/projects/0dc830b4abc34bafb0b585ab301c7fae/users/d26034c9607f4b729ac9dfb294124c5a/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:14.570505 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.571028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.571174 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.597738 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] MFA Rules not processed for user `d26034c9607f4b729ac9dfb294124c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:14.598935 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:14.626732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:14.676457 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1429/2828] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:14.681224 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.750225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc563cd-e22e-468a-afe7-e3feedf51a1a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.754802 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.755460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.755744 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.756928 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.758849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.760804 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.786730 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1400/2829] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:52:14.791318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.801987 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aeea7-db6c-43d1-8716-3dd0e236a7aa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.858663 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.859334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.859624 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.859934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.860677 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.862649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.882926 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1430/2830] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:14 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:14.886952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.897857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde611d-18ce-478a-9133-8cec11ca0163 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.902624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.903285 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.903573 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.903880 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.904670 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.906308 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.916823 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1401/2831] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:14.920506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.930372 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efc2a5-e92d-4deb-b733-1432327b8451 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.934957 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549de5-75e0-4bf9-b4dd-45a858b8742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.935629 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549de5-75e0-4bf9-b4dd-45a858b8742a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.935944 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549de5-75e0-4bf9-b4dd-45a858b8742a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.936225 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549de5-75e0-4bf9-b4dd-45a858b8742a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.936953 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549de5-75e0-4bf9-b4dd-45a858b8742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.938842 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549de5-75e0-4bf9-b4dd-45a858b8742a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:14.949387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1431/2832] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:14.953316 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:14.963657 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09000-4ad6-40af-b1eb-72e91ae57399 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:14.968192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:14.969060 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:14.969342 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:14.969615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] PATH_INFO: `/v3/projects/5c4d694c988d48749c7719dae9750587/users/49767bc7e1404cdd9587a3ef7770d6e0/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:14.982142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:14.989632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4d694c988d48749c7719dae9750587, user_id=49767bc7e1404cdd9587a3ef7770d6e0, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:14.992839 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.010580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1402/2833] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:14 2022] PUT /identity/v3/projects/5c4d694c988d48749c7719dae9750587/users/49767bc7e1404cdd9587a3ef7770d6e0/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:52:15.027263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.027662 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.028041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.061193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] MFA Rules not processed for user `49767bc7e1404cdd9587a3ef7770d6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:15.062410 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:15.125482 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1432/2834] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:15.129949 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.190825 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b4f2-269c-4b4e-8dcd-73c58dce7ef0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.196045 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.196706 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.196995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.197275 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.197964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.199895 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.224850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1403/2835] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:15 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:15.228810 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.239318 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569ed7-5dbc-49a2-8a40-65177c2fd1c5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.278539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:15.304274 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.304968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.305255 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.305530 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.306217 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.308210 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.329177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1433/2836] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:15 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:15.333178 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.343779 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6591d9-7d8a-4117-8944-4d851557ce38 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.348418 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.349072 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.349362 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.349794 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.350491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.352133 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.362732 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1404/2837] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:15.367152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.377128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8db052-4233-48a2-b6e9-2d3f8df013b5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.382636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.383540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.383818 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.384119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] PATH_INFO: `/v3/projects/11b4c78f7d794afb834fd58a54abfa89/users/429d0eeff8c54757b645d07cb11ac136/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.398496 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b4c78f7d794afb834fd58a54abfa89, user_id=429d0eeff8c54757b645d07cb11ac136, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.401229 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.413840 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1434/2838] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:15 2022] PUT /identity/v3/projects/11b4c78f7d794afb834fd58a54abfa89/users/429d0eeff8c54757b645d07cb11ac136/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:15.417769 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.427672 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec74fc-149b-458b-889b-0c9b4c908e02 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.484239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805377-cac6-4c34-b9c9-a207b1ae3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.484897 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805377-cac6-4c34-b9c9-a207b1ae3ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.485173 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805377-cac6-4c34-b9c9-a207b1ae3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.485451 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805377-cac6-4c34-b9c9-a207b1ae3ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.486175 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805377-cac6-4c34-b9c9-a207b1ae3ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.487781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805377-cac6-4c34-b9c9-a207b1ae3ee8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.498587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1405/2839] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:15.502602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.514547 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41138b-e74b-4501-92c0-adb4a4df38a8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.519143 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.520055 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.520339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.520614 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] PATH_INFO: `/v3/projects/11b4c78f7d794afb834fd58a54abfa89/users/429d0eeff8c54757b645d07cb11ac136/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.523612 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b4c78f7d794afb834fd58a54abfa89, user_id=429d0eeff8c54757b645d07cb11ac136, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.526382 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.536645 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1435/2840] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:15 2022] PUT /identity/v3/projects/11b4c78f7d794afb834fd58a54abfa89/users/429d0eeff8c54757b645d07cb11ac136/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:52:15.600372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.600694 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.600972 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.626554 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] MFA Rules not processed for user `429d0eeff8c54757b645d07cb11ac136`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:15.627748 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:15.673736 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:15.695139 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1406/2841] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:15.706177 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.708009 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:15.778223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6cb3-36f5-47fe-9afc-839a1788cb4a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.781851 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.782497 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.782779 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.783053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.792224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.793609 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.802836 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1436/2842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:15.843377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:15.844808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:15.856737 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f142-7653-4d42-b31f-d308ef6a3723 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:15.860366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:15.860999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:15.861284 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:15.861559 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:15.917080 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:15.918518 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:15.927212 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1407/2843] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:17.463493 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:17.465702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:17.532856 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3c699-e787-4e27-acb9-9f265add0c8b service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:17.536595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:17.538723 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:17.539192 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:17.539481 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:17.541339 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:17.586830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:17.607807 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:17.609576 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25405eb-1bbc-47b1-89ba-139ee2b4cc93 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:17.621717 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1437/2844] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:18.836628 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:18.901465 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716cb8a-0822-4fa2-a1e4-f57668d4f282 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:18.905929 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:18.906786 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:18.907073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:18.907348 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] PATH_INFO: `/v3/users/d26034c9607f4b729ac9dfb294124c5a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:18.908549 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26034c9607f4b729ac9dfb294124c5a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:18.910489 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:18.958119 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26034c9607f4b729ac9dfb294124c5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:18.971162 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26034c9607f4b729ac9dfb294124c5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:18.979155 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26034c9607f4b729ac9dfb294124c5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:18.979801 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26034c9607f4b729ac9dfb294124c5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:18.980428 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26034c9607f4b729ac9dfb294124c5a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:18.993621 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1408/2845] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:18 2022] DELETE /identity/v3/users/d26034c9607f4b729ac9dfb294124c5a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:18.998260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:18.998750 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:18.998871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:19.019642 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:19.020891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:19.081578 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1438/2846] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:19.095087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:19.096666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:19.105358 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:19.165111 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc741f9-5975-4f55-9277-0f09be1b395f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:19.169103 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:19.169970 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:19.170142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:19.170534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:19.181394 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:19.182945 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:19.194253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1409/2847] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:19.691153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:19.693230 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:19.708205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f742-eaaf-4045-a5ad-7793f3b8f851 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:19.736053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:19.737106 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:19.737494 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:19.737946 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] PATH_INFO: `/v3/projects/0dc830b4abc34bafb0b585ab301c7fae` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:19.739859 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc830b4abc34bafb0b585ab301c7fae)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:19.742117 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:19.812573 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc830b4abc34bafb0b585ab301c7fae', 'request_id': 'req-b30d8a89-6419-409a-ab6a-d7f4352c7c92'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:19.820476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc830b4abc34bafb0b585ab301c7fae', 'request_id': 'req-b30d8a89-6419-409a-ab6a-d7f4352c7c92'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:19.826604 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc830b4abc34bafb0b585ab301c7fae', 'request_id': 'req-b30d8a89-6419-409a-ab6a-d7f4352c7c92'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:19.844246 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] The token cache is being invalidate because project 0dc830b4abc34bafb0b585ab301c7fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:19.844364 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:19.844994 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:19.847910 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1439/2848] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:19 2022] DELETE /identity/v3/projects/0dc830b4abc34bafb0b585ab301c7fae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:19.852323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:19.869497 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d624966-3bb6-469e-8240-93c0f79cc81c service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:19.968436 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:19.969454 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:19.969840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:19.970214 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] PATH_INFO: `/v3/users/49767bc7e1404cdd9587a3ef7770d6e0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:19.971540 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49767bc7e1404cdd9587a3ef7770d6e0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:19.973599 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:20.060477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49767bc7e1404cdd9587a3ef7770d6e0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.090278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49767bc7e1404cdd9587a3ef7770d6e0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.099297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49767bc7e1404cdd9587a3ef7770d6e0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.100102 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49767bc7e1404cdd9587a3ef7770d6e0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.100927 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49767bc7e1404cdd9587a3ef7770d6e0'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.117848 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1410/2849] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:19 2022] DELETE /identity/v3/users/49767bc7e1404cdd9587a3ef7770d6e0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:20.423631 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:20.425182 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:20.442238 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8a89-6419-409a-ab6a-d7f4352c7c92 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:20.512673 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:20.513551 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:20.513846 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:20.514119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] PATH_INFO: `/v3/projects/5c4d694c988d48749c7719dae9750587` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:20.515327 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4d694c988d48749c7719dae9750587)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:20.517294 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:20.524492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:20.569606 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4d694c988d48749c7719dae9750587', 'request_id': 'req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.575674 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4d694c988d48749c7719dae9750587', 'request_id': 'req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.581216 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4d694c988d48749c7719dae9750587', 'request_id': 'req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.594664 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] The token cache is being invalidate because project 5c4d694c988d48749c7719dae9750587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:20.594955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.595568 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.597129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1440/2850] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:20 2022] DELETE /identity/v3/projects/5c4d694c988d48749c7719dae9750587 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:20.601624 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:20.603295 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:20.619918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac74a69-0559-4851-8176-04a11d6c22e9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:20.643666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:20.680999 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:20.681886 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:20.682181 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:20.682463 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] PATH_INFO: `/v3/users/429d0eeff8c54757b645d07cb11ac136` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:20.683674 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429d0eeff8c54757b645d07cb11ac136)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:20.685658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:20.732855 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429d0eeff8c54757b645d07cb11ac136'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.747548 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429d0eeff8c54757b645d07cb11ac136'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.755727 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429d0eeff8c54757b645d07cb11ac136'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.756752 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429d0eeff8c54757b645d07cb11ac136'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.757466 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9329905-c85c-4c42-bb1f-8cb427fc7af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429d0eeff8c54757b645d07cb11ac136'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:20.770669 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1411/2851] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:20 2022] DELETE /identity/v3/users/429d0eeff8c54757b645d07cb11ac136 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:21.252780 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:21.254376 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:21.277301 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d80a-9581-4d4e-9006-4ab4ce7a00c9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:21.398901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:21.399393 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.399675 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.399995 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] PATH_INFO: `/v3/projects/11b4c78f7d794afb834fd58a54abfa89` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.401289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b4c78f7d794afb834fd58a54abfa89)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:21.403691 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:21.480924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b4c78f7d794afb834fd58a54abfa89', 'request_id': 'req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:21.489791 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b4c78f7d794afb834fd58a54abfa89', 'request_id': 'req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:21.499592 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b4c78f7d794afb834fd58a54abfa89', 'request_id': 'req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:21.533523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] The token cache is being invalidate because project 11b4c78f7d794afb834fd58a54abfa89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:21.534838 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:21.535862 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22c4e73c-a77b-4714-a4b6-a90aafd2ccdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:21.539028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1441/2852] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:21 2022] DELETE /identity/v3/projects/11b4c78f7d794afb834fd58a54abfa89 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:21.545323 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.545844 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.545967 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.566401 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:21.567650 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:21.654336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1412/2853] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:21.664304 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.664671 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.664980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.685340 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:21.686587 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:21.701103 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1442/2854] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:52:21.702373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:21.715321 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451051-300b-4ed1-a8c4-f2ea2d96261d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:21.720710 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:21.721437 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.721666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.721947 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.722783 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 18:52:21.723426 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:21.726297 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:21.745336 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1413/2855] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 18:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 18:52:21.746809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:21.764732 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ebf3-66c6-4665-8c67-c439ae3afb91 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:21.770909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:21.772024 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.772685 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.773195 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.774687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:21.776768 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:21.794218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:21.818952 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:21.828010 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1443/2856] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:21 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:52:21.830136 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47383-b010-4243-a948-778dd1afaaa2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:21.870996 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:21.904198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:21.905118 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.905404 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.905678 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.906373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:21.908335 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:21.935493 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1414/2857] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:21 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:21.938281 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:21.952523 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b4e0-3c47-4fa5-a4e4-4717b26d0906 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:21.961231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:21.962076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:21.962800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:21.962800 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:21.963696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:21.965653 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:21.978015 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1444/2858] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:21.982263 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:21.998934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eff827-2d23-4bf4-9507-51ab2a682fd3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.004207 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7c556-beca-4df4-a89a-129af873900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.004963 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7c556-beca-4df4-a89a-129af873900b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.005482 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7c556-beca-4df4-a89a-129af873900b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.006686 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7c556-beca-4df4-a89a-129af873900b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.007515 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7c556-beca-4df4-a89a-129af873900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.009226 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7c556-beca-4df4-a89a-129af873900b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.019525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1415/2859] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:22.023781 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.034232 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905bd8f-bfe8-4a74-8fe0-2ff2c39a2662 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.039744 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.040680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.040969 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.041249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] PATH_INFO: `/v3/projects/0020ea11aae442bb8f63f78493f48917/users/1bf66c5281c04065869723b683fc039a/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.057098 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0020ea11aae442bb8f63f78493f48917, user_id=1bf66c5281c04065869723b683fc039a, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.059860 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.074759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1445/2860] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:22 2022] PUT /identity/v3/projects/0020ea11aae442bb8f63f78493f48917/users/1bf66c5281c04065869723b683fc039a/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:22.087142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.087431 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.087709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.113259 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] MFA Rules not processed for user `1bf66c5281c04065869723b683fc039a`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:22.114453 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:22.178843 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1416/2861] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:22.183263 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.243665 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fec18-025e-4c9e-a764-2f908306e93a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.248405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.249057 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.249344 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.249618 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.250298 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.252270 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.277331 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1446/2862] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:22 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:22.281334 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.291969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22211-7860-4e9f-821b-1f95bb9f21f3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.347055 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.348165 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.348456 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.348735 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.349936 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.351896 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.371460 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1417/2863] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:22 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:22.375400 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.385841 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b28c3-0a7c-48df-8bad-f989b7715b58 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.390402 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.391049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.391334 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.391607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.392355 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.393984 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.404555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1447/2864] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:22.408251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.418488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5f2d-6cdc-4b6a-9994-407759049a50 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.422984 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c60d-9cbb-4fcb-8d13-95688482d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.423634 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c60d-9cbb-4fcb-8d13-95688482d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.423953 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c60d-9cbb-4fcb-8d13-95688482d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.424236 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c60d-9cbb-4fcb-8d13-95688482d5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.424990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c60d-9cbb-4fcb-8d13-95688482d5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.426577 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c60d-9cbb-4fcb-8d13-95688482d5dd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.436932 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1418/2865] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:22.440701 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.450871 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cea2bc-99f8-4301-846f-0ed51523c9f9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.455680 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.456602 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.456891 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.457167 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] PATH_INFO: `/v3/projects/066f51e2aaf74a62a34a34b0a0ba45f7/users/a2adb9d517d44c34b5dfd08c6d9f9bee/roles/fde1ffae211846158ce1303a9da8610d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.471824 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066f51e2aaf74a62a34a34b0a0ba45f7, user_id=a2adb9d517d44c34b5dfd08c6d9f9bee, role_id=fde1ffae211846158ce1303a9da8610d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.475011 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.488357 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1448/2866] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:22 2022] PUT /identity/v3/projects/066f51e2aaf74a62a34a34b0a0ba45f7/users/a2adb9d517d44c34b5dfd08c6d9f9bee/roles/fde1ffae211846158ce1303a9da8610d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:52:22.499276 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.499591 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.499902 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.526562 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] MFA Rules not processed for user `a2adb9d517d44c34b5dfd08c6d9f9bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:22.527629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:22.535849 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:22.596600 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1419/2867] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:22.601725 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.661772 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1428-40ff-4c7c-be69-6924df03d1c5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.667062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.667739 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.668041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.668329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.669020 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.670955 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.685050 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:22.697405 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1449/2868] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 18:52:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 18:52:22.701477 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.712561 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced6c11-9557-430b-89a8-ca4062383857 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.771194 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.772092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.772379 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.772660 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.773357 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.775290 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.795192 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1420/2869] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 18:52:22 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 18:52:22.799138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.812909 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b7e3f-5fa5-4516-88ee-d010d660a074 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.817690 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.819532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.819827 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.820138 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.820877 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.823353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.836825 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1450/2870] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:22.844142 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.855777 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005364f8-253f-4275-a03c-ebec2a807cd9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.861934 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.862840 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.863120 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.863392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] PATH_INFO: `/v3/projects/f375b468c808410085f7fc0e85d6d30b/users/e96d806ca509459b9438b7e9c38d3e2e/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.878491 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f375b468c808410085f7fc0e85d6d30b, user_id=e96d806ca509459b9438b7e9c38d3e2e, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.882364 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.894858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1421/2871] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:22 2022] PUT /identity/v3/projects/f375b468c808410085f7fc0e85d6d30b/users/e96d806ca509459b9438b7e9c38d3e2e/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:22.899465 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.909249 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee7ffa-bf76-4e42-8f2e-affb7b5853a2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.965692 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2ba6-14f5-43c1-807b-287a3de046f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.966289 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2ba6-14f5-43c1-807b-287a3de046f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.966580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2ba6-14f5-43c1-807b-287a3de046f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:22.966861 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2ba6-14f5-43c1-807b-287a3de046f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:22.967589 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2ba6-14f5-43c1-807b-287a3de046f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:22.969240 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2ba6-14f5-43c1-807b-287a3de046f7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:22.978964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1451/2872] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 18:52:22.983130 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:22.994210 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9406e3-2a19-49aa-94c7-9c0ac0f28609 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:22.998740 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:22.999662 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:22.999982 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:23.000260 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] PATH_INFO: `/v3/projects/f375b468c808410085f7fc0e85d6d30b/users/e96d806ca509459b9438b7e9c38d3e2e/roles/5299c6b6eaad463a8c04cf2d50c61c9c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:23.002253 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f375b468c808410085f7fc0e85d6d30b, user_id=e96d806ca509459b9438b7e9c38d3e2e, role_id=5299c6b6eaad463a8c04cf2d50c61c9c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:23.004939 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:23.015690 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1422/2873] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 18:52:22 2022] PUT /identity/v3/projects/f375b468c808410085f7fc0e85d6d30b/users/e96d806ca509459b9438b7e9c38d3e2e/roles/5299c6b6eaad463a8c04cf2d50c61c9c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:23.025567 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:23.025858 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:23.026137 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:23.051153 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] MFA Rules not processed for user `e96d806ca509459b9438b7e9c38d3e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:23.052389 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:23.120329 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1452/2874] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:23.135503 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:23.138098 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:23.196104 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bebf9-f569-4a60-b822-7f7b2d16ab33 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:23.199713 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:23.200387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:23.200673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:23.200951 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:23.214630 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:23.259920 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:23.261372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:23.270238 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1423/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:24.746890 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:24.748338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:24.762395 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d26ba-6033-488c-8e27-345e28e74d5a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:24.766062 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:24.766730 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:24.767032 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:24.767341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:24.825696 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:24.827060 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:24.836752 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1453/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:25.339647 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:25.348387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677ef4b-abc5-4f2b-b9db-82682ed01271 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:25.352608 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9633bc-47b4-4d22-87e0-8546758bbb9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bb9cc9e4c34504ac6574c28963b4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:25.353243 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9633bc-47b4-4d22-87e0-8546758bbb9b service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:25.353530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9633bc-47b4-4d22-87e0-8546758bbb9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:25.353808 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9633bc-47b4-4d22-87e0-8546758bbb9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:25.362757 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9633bc-47b4-4d22-87e0-8546758bbb9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:25.364225 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9633bc-47b4-4d22-87e0-8546758bbb9b service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:25.374914 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1424/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:29.205119 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:29.210472 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:29.267133 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea463444-fe3c-4346-8100-d50f047a5147 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:29.273630 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:29.274500 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:29.274783 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:29.275084 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] PATH_INFO: `/v3/users/1bf66c5281c04065869723b683fc039a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:29.276387 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf66c5281c04065869723b683fc039a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:29.278333 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:29.323254 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf66c5281c04065869723b683fc039a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.335597 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf66c5281c04065869723b683fc039a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.342901 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf66c5281c04065869723b683fc039a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.343549 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf66c5281c04065869723b683fc039a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.351146 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf66c5281c04065869723b683fc039a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.357049 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1454/2878] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:29 2022] DELETE /identity/v3/users/1bf66c5281c04065869723b683fc039a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:29.362058 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:29.362579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:29.362692 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:29.380439 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] MFA Rules not processed for user `2a54999c7536405a8d0c6aa5dc9fba82`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:52:29.382387 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:29.439944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1425/2879] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 18:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:52:29.449487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:29.450974 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:29.507076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814a3f-1736-43c9-88b9-628b3d819e0f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:29.510655 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:29.511358 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:29.511585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:29.511882 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:29.522163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:29.524128 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:29.533218 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1455/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:52:29.801507 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:29.804331 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:29.825228 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0d20e-b890-4cc7-b69e-5c84eae6704d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:29.830433 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:29.831371 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:29.831579 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:29.831885 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] PATH_INFO: `/v3/projects/0020ea11aae442bb8f63f78493f48917` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:29.833079 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0020ea11aae442bb8f63f78493f48917)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:29.835185 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:29.884950 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0020ea11aae442bb8f63f78493f48917', 'request_id': 'req-29f5460f-a969-4c50-8b24-4dcd0cf6979b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.891180 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0020ea11aae442bb8f63f78493f48917', 'request_id': 'req-29f5460f-a969-4c50-8b24-4dcd0cf6979b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.896798 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0020ea11aae442bb8f63f78493f48917', 'request_id': 'req-29f5460f-a969-4c50-8b24-4dcd0cf6979b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.909272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] The token cache is being invalidate because project 0020ea11aae442bb8f63f78493f48917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:29.909569 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.910198 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:29.912347 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1426/2881] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:29 2022] DELETE /identity/v3/projects/0020ea11aae442bb8f63f78493f48917 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:29.916613 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:29.926548 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca878a-c641-4853-988a-e09d98389265 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:29.951250 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:29.984964 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:29.985759 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:29.986045 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:29.986324 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] PATH_INFO: `/v3/users/a2adb9d517d44c34b5dfd08c6d9f9bee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:29.987515 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2adb9d517d44c34b5dfd08c6d9f9bee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:29.989495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:30.036353 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2adb9d517d44c34b5dfd08c6d9f9bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.048802 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2adb9d517d44c34b5dfd08c6d9f9bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.057152 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2adb9d517d44c34b5dfd08c6d9f9bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.057765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2adb9d517d44c34b5dfd08c6d9f9bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.064610 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2adb9d517d44c34b5dfd08c6d9f9bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.070460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1456/2882] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:29 2022] DELETE /identity/v3/users/a2adb9d517d44c34b5dfd08c6d9f9bee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:30.356589 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:30.358235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:30.374086 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5460f-a969-4c50-8b24-4dcd0cf6979b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:30.399955 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:30.439223 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:30.443858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:30.443858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:30.443858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] PATH_INFO: `/v3/projects/066f51e2aaf74a62a34a34b0a0ba45f7` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:30.443858 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=066f51e2aaf74a62a34a34b0a0ba45f7)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:30.444534 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:30.495968 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066f51e2aaf74a62a34a34b0a0ba45f7', 'request_id': 'req-40877442-1b42-4375-bf25-881d2900a121'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.501993 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066f51e2aaf74a62a34a34b0a0ba45f7', 'request_id': 'req-40877442-1b42-4375-bf25-881d2900a121'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.507759 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066f51e2aaf74a62a34a34b0a0ba45f7', 'request_id': 'req-40877442-1b42-4375-bf25-881d2900a121'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.521002 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] The token cache is being invalidate because project 066f51e2aaf74a62a34a34b0a0ba45f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:30.521875 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.522658 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.524250 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1427/2883] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:30 2022] DELETE /identity/v3/projects/066f51e2aaf74a62a34a34b0a0ba45f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:30.528560 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:30.529908 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:30.543622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810582-f8b4-4016-9890-5361d0eb45c1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:30.600443 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:30.601292 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:30.601575 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:30.601849 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] PATH_INFO: `/v3/users/e96d806ca509459b9438b7e9c38d3e2e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:30.603063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96d806ca509459b9438b7e9c38d3e2e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:30.605067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:30.655712 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96d806ca509459b9438b7e9c38d3e2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.656868 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:30.670162 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96d806ca509459b9438b7e9c38d3e2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.677071 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96d806ca509459b9438b7e9c38d3e2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.678315 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96d806ca509459b9438b7e9c38d3e2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.685268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96d806ca509459b9438b7e9c38d3e2e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:30.691052 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1457/2884] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:52:30 2022] DELETE /identity/v3/users/e96d806ca509459b9438b7e9c38d3e2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:30.956909 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:52:30.960122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:52:30.975683 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877442-1b42-4375-bf25-881d2900a121 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:52:31.034673 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:52:31.035528 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:52:31.035814 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:52:31.036125 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] PATH_INFO: `/v3/projects/f375b468c808410085f7fc0e85d6d30b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:52:31.037427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f375b468c808410085f7fc0e85d6d30b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:52:31.039289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:52:31.085971 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f375b468c808410085f7fc0e85d6d30b', 'request_id': 'req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:31.092254 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f375b468c808410085f7fc0e85d6d30b', 'request_id': 'req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:31.096167 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:31.098580 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f375b468c808410085f7fc0e85d6d30b', 'request_id': 'req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:31.111390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] The token cache is being invalidate because project f375b468c808410085f7fc0e85d6d30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:52:31.111666 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:31.112341 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:52:31.113943 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1428/2885] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:52:30 2022] DELETE /identity/v3/projects/f375b468c808410085f7fc0e85d6d30b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:52:40.687622 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:41.108373 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=2,keystone:SELECT=3,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:22.256513 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:53:22.258380 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:53:22.322362 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a41aa-4568-41bf-9735-4e5b9fca850e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:53:22.371924 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:53:22.372595 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:53:22.372888 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:53:22.373173 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:53:22.374968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:53:22.460269 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:53:22.462897 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:53:22.483980 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1458/2886] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:53:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:53:23.767962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:53:23.769422 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:53:23.782523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a783a-30eb-4b61-9f15-ebb0f7028ce5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:53:23.786114 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:53:23.786747 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:53:23.787036 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:53:23.787303 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:53:23.789005 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:53:23.802704 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:53:23.804174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359dfa4-1f67-48e9-8329-e831e698db9a service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:53:23.814990 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1429/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:53:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:53:32.481373 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:33.810251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:08.730539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:08.732102 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:08.742923 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f1ed0-fa21-4ff4-ab88-45eb3727ab02 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:08.746554 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:08.747198 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:08.747487 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:08.747763 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:08.749607 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:08.760820 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:08.762268 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61911-dd09-464c-93ee-8b2e6dc42a6d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:08.771205 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1459/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:15.915168 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a657b-1094-4b57-8b20-7b8f1baff2ba None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:15.915995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a657b-1094-4b57-8b20-7b8f1baff2ba None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:15.915995 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a657b-1094-4b57-8b20-7b8f1baff2ba None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:15.917164 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1430/2889] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:54:15.923341 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca752ce9-3cb7-4611-a8aa-1bbb798fdf07 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:15.923828 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca752ce9-3cb7-4611-a8aa-1bbb798fdf07 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:15.923981 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca752ce9-3cb7-4611-a8aa-1bbb798fdf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:15.962126 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ca752ce9-3cb7-4611-a8aa-1bbb798fdf07 None None] MFA Rules not processed for user `0a7d067e3f3c4f778ec5eedccc202fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:54:15.963390 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca752ce9-3cb7-4611-a8aa-1bbb798fdf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:15.970224 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1460/2890] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:54:15.984174 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a657b-1094-4b57-8b20-7b8f1baff2ba None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:15.996258 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a657b-1094-4b57-8b20-7b8f1baff2ba None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:15.999962 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b385-edf6-4686-abe1-3214998ede16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:16.000935 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b385-edf6-4686-abe1-3214998ede16 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:16.001249 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b385-edf6-4686-abe1-3214998ede16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:16.001530 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b385-edf6-4686-abe1-3214998ede16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:16.009352 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b385-edf6-4686-abe1-3214998ede16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:16.010781 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b385-edf6-4686-abe1-3214998ede16 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:16.019277 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1431/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:16.111053 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbe82-350c-4e03-b11e-e71283fa3fa4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:16.111350 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbe82-350c-4e03-b11e-e71283fa3fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:16.111636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbe82-350c-4e03-b11e-e71283fa3fa4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:16.113068 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1461/2892] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 18:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 18:54:16.118969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:16.119251 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:16.119523 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:16.156073 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] MFA Rules not processed for user `fd8232022633460fbaa7479477d4014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:54:16.157266 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:16.166587 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1432/2893] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 18:54:16.176902 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbe82-350c-4e03-b11e-e71283fa3fa4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:16.188285 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbe82-350c-4e03-b11e-e71283fa3fa4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:16.191714 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:16.192379 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:16.192661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:16.192934 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:16.203711 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:16.205163 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:16.215636 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1462/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:16.277200 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:16.278568 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:16.344289 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb514af1-d39f-45ae-8325-30f9291d3eb9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:16.349231 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:16.349864 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:16.350147 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:16.350424 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:16.352774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:16.363899 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:16.365478 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:16.376022 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1433/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:26.211041 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=21 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:26.371649 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=47 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:38.181649 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:38.182532 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:38.205309 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec5599-fd85-46a1-ae74-4811251db2cc service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:38.212506 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:38.213275 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:38.213619 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:38.214431 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:38.216540 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:38.230782 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:38.232433 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f2ab5-76f2-4a94-98f7-1eb3df64dd83 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:38.251160 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1463/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:44.757137 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:44.777338 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f2a3e-1699-466a-816e-bcd715ff9e26 service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:44.784278 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd8232022633460fbaa7479477d4014d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:44.784969 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:44.785389 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:44.785697 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:44.789632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:44.803434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:44.805918 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:44.827511 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1434/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:45.958668 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:45.959136 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:45.959244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:45.977968 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] MFA Rules not processed for user `52b394e0a6464e1592af1956cabc52f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 18:54:45.979164 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:46.033687 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1464/2898] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 18:54:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 18:54:46.073661 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:46.075056 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:46.143360 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6248a8-2e58-442f-81df-a0a046333366 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:46.148434 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82d117152a54ebcbd6cf9291bef3f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:46.149075 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:46.149356 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:46.149629 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:46.157598 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:46.159190 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:46.167588 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1435/2899] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 18:54:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 18:54:49.326963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:49.329261 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:49.348444 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834955-04d0-4497-ba31-eeaad6c8ad82 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:49.357367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:49.358476 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:49.358758 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:49.359043 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:49.361046 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:49.376460 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:49.378686 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:49.406396 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1465/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:54:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:54:52.577627 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:52.579615 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:52.645964 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6811-e56d-4612-a2e5-f48f108c1607 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:52.652202 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:52.653317 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:52.653852 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:52.654384 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] PATH_INFO: `/v3/users/b183452d65b94bb0b0ce507cc9db4d08` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:52.656447 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b183452d65b94bb0b0ce507cc9db4d08)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:52.658551 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:52.721378 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b183452d65b94bb0b0ce507cc9db4d08'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:52.734925 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b183452d65b94bb0b0ce507cc9db4d08'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:52.742533 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b183452d65b94bb0b0ce507cc9db4d08'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:52.743127 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b183452d65b94bb0b0ce507cc9db4d08'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:52.743693 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b183452d65b94bb0b0ce507cc9db4d08'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:52.752271 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:52.757877 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1436/2901] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:54:52 2022] DELETE /identity/v3/users/b183452d65b94bb0b0ce507cc9db4d08 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:54:52.928522 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:52.941178 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c51fc-75dc-4d58-b8f0-1d85727f58bc service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:53.012621 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:53.013512 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:53.013809 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:53.014081 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] PATH_INFO: `/v3/projects/6be45c6791274b4c9f58753498a1684d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:53.015338 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be45c6791274b4c9f58753498a1684d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:53.017423 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:53.064226 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be45c6791274b4c9f58753498a1684d', 'request_id': 'req-0940b9d0-87b5-4025-8600-5a2601a0b629'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.070245 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be45c6791274b4c9f58753498a1684d', 'request_id': 'req-0940b9d0-87b5-4025-8600-5a2601a0b629'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.077076 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be45c6791274b4c9f58753498a1684d', 'request_id': 'req-0940b9d0-87b5-4025-8600-5a2601a0b629'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.089765 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] The token cache is being invalidate because project 6be45c6791274b4c9f58753498a1684d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:54:53.090063 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.090697 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.092260 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1466/2902] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:54:52 2022] DELETE /identity/v3/projects/6be45c6791274b4c9f58753498a1684d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:54:53.096300 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:53.097723 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:53.110907 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643b75e-2578-4c9c-8d1d-cb77704acbf9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:53.169096 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:53.169959 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:53.170265 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:53.170545 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] PATH_INFO: `/v3/users/7511d5994c274c9697a9c4da605c2af5` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:53.171717 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7511d5994c274c9697a9c4da605c2af5)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:53.173792 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:53.219390 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7511d5994c274c9697a9c4da605c2af5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.231066 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7511d5994c274c9697a9c4da605c2af5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.238230 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7511d5994c274c9697a9c4da605c2af5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.238941 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7511d5994c274c9697a9c4da605c2af5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.239571 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7511d5994c274c9697a9c4da605c2af5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.252632 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1437/2903] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:54:53 2022] DELETE /identity/v3/users/7511d5994c274c9697a9c4da605c2af5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:54:53.425325 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:54:53.426834 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:54:53.440866 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940b9d0-87b5-4025-8600-5a2601a0b629 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:54:53.446264 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:53.506844 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:54:53.507713 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:54:53.508047 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:54:53.508580 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] PATH_INFO: `/v3/projects/7bfa26bfeace463f95e3fd94d71b6be5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:54:53.511585 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfa26bfeace463f95e3fd94d71b6be5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:54:53.513483 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:54:53.563193 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfa26bfeace463f95e3fd94d71b6be5', 'request_id': 'req-3a918308-eea3-4177-811b-9d6fc99fdc6f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.569378 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfa26bfeace463f95e3fd94d71b6be5', 'request_id': 'req-3a918308-eea3-4177-811b-9d6fc99fdc6f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.576028 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfa26bfeace463f95e3fd94d71b6be5', 'request_id': 'req-3a918308-eea3-4177-811b-9d6fc99fdc6f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.590991 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] The token cache is being invalidate because project 7bfa26bfeace463f95e3fd94d71b6be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:54:53.591283 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.591959 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:54:53.593492 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1467/2904] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:54:53 2022] DELETE /identity/v3/projects/7bfa26bfeace463f95e3fd94d71b6be5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:55:03.250614 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:55:03.587149 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:06.616427 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:56:06.617863 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:06.676082 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf905-982f-48c0-bd92-6c9ff9ba8531 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:56:06.724765 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:56:06.725408 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:56:06.725695 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:56:06.726001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:56:06.727774 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:06.786392 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:56:06.787857 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:56:06.797141 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1438/2905] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:56:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:56:11.719676 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:56:11.721223 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:11.734170 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918308-eea3-4177-811b-9d6fc99fdc6f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:56:11.737633 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7d067e3f3c4f778ec5eedccc202fc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:56:11.738273 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:56:11.738555 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:56:11.738830 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:56:11.740569 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:11.804495 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:56:11.805938 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:56:11.817406 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1468/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:56:16.792860 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=68 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:17.812709 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:56:17.814366 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:17.829698 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf49f-42a0-46dc-a9db-4707f11bb400 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:56:17.834372 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:56:17.835244 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:56:17.835527 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:56:17.835803 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] PATH_INFO: `/v3/users/16029fcf926c49f9b8cf10f41db61436` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:56:17.837030 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16029fcf926c49f9b8cf10f41db61436)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:56:17.838956 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:56:17.889525 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16029fcf926c49f9b8cf10f41db61436'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:17.902087 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16029fcf926c49f9b8cf10f41db61436'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:17.910462 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16029fcf926c49f9b8cf10f41db61436'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:17.911239 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16029fcf926c49f9b8cf10f41db61436'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:17.911937 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16029fcf926c49f9b8cf10f41db61436'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:17.925413 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1439/2907] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:56:17 2022] DELETE /identity/v3/users/16029fcf926c49f9b8cf10f41db61436 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:56:18.108735 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:56:18.119056 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fa4b0-1840-47fe-a207-2c012131e4b6 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:56:18.178702 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:56:18.179572 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:56:18.179885 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:56:18.180175 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] PATH_INFO: `/v3/projects/5ccf6560673c40cb9f4acb20d10400c6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:56:18.181367 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccf6560673c40cb9f4acb20d10400c6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:56:18.184004 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:56:18.228784 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccf6560673c40cb9f4acb20d10400c6', 'request_id': 'req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.234963 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccf6560673c40cb9f4acb20d10400c6', 'request_id': 'req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.240458 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccf6560673c40cb9f4acb20d10400c6', 'request_id': 'req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.253228 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] The token cache is being invalidate because project 5ccf6560673c40cb9f4acb20d10400c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:56:18.253518 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.254129 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.255693 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1469/2908] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:56:18 2022] DELETE /identity/v3/projects/5ccf6560673c40cb9f4acb20d10400c6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 18:56:18.259978 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:56:18.261565 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:18.274850 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c049f0b-4af6-411c-9f11-ef6304201f60 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:56:18.330219 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:56:18.331092 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:56:18.331377 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:56:18.331653 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] PATH_INFO: `/v3/users/580707ec89d143bf9b0156fd6fa74df4` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:56:18.332872 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580707ec89d143bf9b0156fd6fa74df4)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:56:18.334809 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:56:18.379522 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580707ec89d143bf9b0156fd6fa74df4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.392016 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580707ec89d143bf9b0156fd6fa74df4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.399349 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580707ec89d143bf9b0156fd6fa74df4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.400021 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580707ec89d143bf9b0156fd6fa74df4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.400641 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580707ec89d143bf9b0156fd6fa74df4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.403235 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:18.415488 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1440/2909] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 18:56:18 2022] DELETE /identity/v3/users/580707ec89d143bf9b0156fd6fa74df4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:56:18.587579 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:56:18.589973 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:56:18.602845 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a75a-e0b6-44f7-a4ac-25d3a5e50e36 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:56:18.624661 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:18.662679 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a54999c7536405a8d0c6aa5dc9fba82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5555f070d6fd48a3923494f663482206', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:56:18.663474 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:56:18.663760 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:56:18.664067 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] PATH_INFO: `/v3/projects/27a1d9c58aad460fbdbb1b8d359faf32` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:56:18.665291 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a1d9c58aad460fbdbb1b8d359faf32)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:56:18.667244 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:56:18.713231 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a1d9c58aad460fbdbb1b8d359faf32', 'request_id': 'req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.719635 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a1d9c58aad460fbdbb1b8d359faf32', 'request_id': 'req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.725072 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a1d9c58aad460fbdbb1b8d359faf32', 'request_id': 'req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.737539 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] The token cache is being invalidate because project 27a1d9c58aad460fbdbb1b8d359faf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 18:56:18.737833 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.738449 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-833cce68-2f7f-4598-b8c8-bf18ddac4ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 18:56:18.739989 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1470/2910] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 18:56:18 2022] DELETE /identity/v3/projects/27a1d9c58aad460fbdbb1b8d359faf32 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 18:56:28.413703 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:28.734683 dv-cinder-812685-11-iscsi devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:57:13.943001 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 18:57:13.944446 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:57:14.014944 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5af18-6603-4e1f-853e-35515260fc41 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 18:57:14.074064 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f3f2c10f9fc444aba93f0d999359662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de94e3ce9f9c4bbe8dc9c99f79c4bcab', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 18:57:14.075866 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 18:57:14.076170 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 18:57:14.076448 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 18:57:14.078272 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 18:57:14.089385 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 18:57:14.091508 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02209f1-41b0-4d3f-b751-71fbaf857c57 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 18:57:14.101256 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1441/2911] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 18:57:24.097122 dv-cinder-812685-11-iscsi devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=58 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}